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ABSTRACT 

Individually Guided Education (IGE) is a complex 
educational system intended to enable the elementary school to 
provide an environment where students learn at a rate and in a manner 
appropriate to their own learning styles. This descriptive study 
concerns the iaplementaticn of the Wisconsin Design for Reading Skill 
Development (WDRSD) ^ an instructive management system which was 
created to be compatible with the IGE system. The WDRSD is an 
objective-based system that provides both structure and substance for 
an elementary school reading program. The focus is on developing the 
essential subskills of reading^ which cnce acquired and applied 
enable students to read successfully. The WDRSD has four fundamental 
purposes: (1) to identify and describe instructional objectives for 
the skills which appear essential for competence in reading; (2) to 
assess individual pupils* skill development status; (3) to manage 
instruction of children wi^h different skill development needs; and 
(U) to monitor each pupil's progress. Grades 2 and 5 participated at 
each school r and data were collected through tests on general 
objectives of the program^ observations^ teacher iogsr and 
interviews. Profiles by school for each grade on means of instruction 
(pacing^ grouping^ materialsr and interactions) r time use (allocated^ 
ncnappliedr available^ and engaged time) , and achievement provide a 
basis for discussing the relationships among variables. 
(Authors/CJ) 
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The miss ion ol: the Wir.consiri lU.»Mt'at;c:h and [Jcvr? h >i 'iiu-ii t Cfnt.ct 
is to improve the quality ot: uducaticjn by a.lclr om.s inq the tull 
ranqe of israies and prohlom^^. related to i nd iv idua 1 i iruni r.choo 1 i n<j . 
Teaching, learninq, and the probicjms of individua 1 .i./>a t ion are 
given concurrent attention in tlie Center's efforts to discover 
processes and develop strateqies and materials for use in tlie 
schools. The Center pursues its mission by 

• conducting and synthesizinq research to clarify tlu- 
processes of school-age children's learning and 
development 

• conducting and synthesizinq research to clarify effective 
approaches to teaching students basic skills and concepts 

• developing and demonstrating improved instructional strateqies, 
processes, and materials for students, teachers, and school 
administrators 

• providing assistance to educators which helps transfer the 
outcomes of research and development to improved practice 
in local schools and teacher education institutions 

The Wisconsin Research and Development Center is supported 
with funds from the National Institute of Education and the 
University of Wisconsin. 



WISCONSIN RESEARCH AND DEVELOPMENT 
CENTER FOR INDIVIDUALIZED SCHOOLING 



5 



hi ML (W* 'i'ciblon vi I 

List ol: Ficjurou xi 

Abis tract xii. i. 

I . Introduction I 

IGE eind the Evaluation Project 1 

Overview of Phase IV ^ 

Overview of Remaining Sections i^i 

II. Procedures 9 

The WDRSD program 9 

Content Aggregations 12 

Data Collection 13 

III. Description of the Schools 23 

Demographic Background 23 

IGE Characteristics 24 

Program Use 25 

Initial Achievement 27 

IV. Means of Instruction Profiles 31 

School 452, Grade 2 32 

School 504, Grade 2 36 

Comparison of Schools 452 and 540, Grade 2 40 

School 452, Grade 5 42 

School 504, Grade 5 47 

Comparison of Schools 452 and 504, Grade 5 51 

V. Time Profiles 53 

Grade 2 54 

Distribution of Instructional Days 54 

Allocated, Availeible, and Average Daily Time 54 

Time Profile by General Objective 59 

Comparison of Schools 452 and 504, Grade 2 63 

Grade 5 64 

Distribution of Instructional Days 64 

Allocated, Available, and Average Daily Time 64 

V 

e 



•raljUi lit' t'oiU.niU.ji (t.-niU iuiuul) 



'L'Lmu ProL'LluM by tluuotaL t)h jiuM. i vti iih 

ComiMT Ltion o|: .St!ht)t)l.M *Vu! aiui i;i(Hlti '» 7 1 

VI . /\(Mi it?vt!munt. Prol LluM 

c;Ladu A 7 7 

Acliiovomunt Monitoring .Scorun 77 

Domain Koferonced ScoruH 7') 

Comparison of Target Students to Totai Groui> iVi 

Contrast Dotweun Schools on AclvLo vamont 

Gradu 5 8*^) 

Achievement Monitoring Scores . 09 

Domain Referenced Scores 92 

Comparison of Target Students to Total Group 95 

Contrast Between Schools on Achievement 97 

VII. Interrelationships Between the Time and Achievement 

Variables 101 

References 119 



vi 



1. Wl)l<:»l) Slvill.M by I'lltMntial. autl hy 'IM vul i I i mia I. iIi.uIm l.uvnl . , , II 

V.u Liiblnji liir ;H;hi)nl.:j '\[).\ 

J Mi.'oriiM i)a l:hu rruqr:<nii llMti JUjclLum .!M 

'I Purcuntaqo Coi'fout: L'or Enititii Ac;li i ovoment for 12 DtsnotaL 

Obioctivuii 

13 Percont of Aliocatod and Avaiiablo Tlmuii ^md Avoraqu Daily 
Time from Observationu for Moans ol: lUMtruction and Inter- 
action Variables 3.1 

Cj Variation by Day in Other Paced and liarqe Group Instruc- 
tion J4 

7 Percent of Allocated and Available Times and Avoracje Daily 
Time from Observations for Means of Instruction and Inter- 
action Variables (School 504, Grade 2) 37 

0 Range and Mean of Allocated Time in Percentages for Means 
of Instruction Varicibles for Each Observation Day (School 
504, Gr^de 2) 38 

9 Percent of Allocated and Available Times and Average Daily 
Time from Observations for Means of Instruction and Inter- 
action Varicbles (School 452, Grade 5) 43 

10 Range and Mean of Allocated Time in Percentages for Meam' 
of Instruction Varicibles for Each Observation Day (School 

452, Grade 5) 44 

11 Percent of Allocated and Available Times and Average Daily 
Time from Observations for Means of Instruction and Inter- 
action Variables (School 504, Grade 5) 48 

12 Range and Mean of Allocated Time in Percentages for Means 
of Instruction Variables for Each Observation Day (School 

504, Grade 5) 49 

13 Average Distribution of Instructional Days for Periods A 
and B and for the Total Period (Schools 452 and 504, 

Grade 2) 55 



VI 1 



EKLC 



8 



14 l»ij|.i!unli «»r Alloiatn.l rtiul Av.iilal)U^ aMmuu ami /Wm atfu Dally 
Tiuui Crnm ohtuu-vai-iouM roi* MuauM lauii i \u!l iou ami iiUtu 
aiJllon Vai. l.a|)Uwi (Scliuol. -IS^ ^ tii aiiu 2) 'u> 

15 I'uhmhU. ot Al. Lnuat.thl an»l Av»i i. l.abUi 'riuwin rnr Avnra<|ti Dally 
'iMnui l rt»m Ob.'uu vat U)iui for MOiUUi ol: ItuiUrut'U Ion aiul luUu - 
ac:Lion Vari.ahloji (Si^Uool. , ilrado *!) %H 

U» 'ri.mo ALIocation r'rom Lo(jm aiul Ohf.;o rVLU:.i,oa;i on Oonoral Oh- 

)n(?tLv'JM For: Ono SUiuiunt My Pur.lod (School -1^2, c.lraclu . . 

17 'I'lma Allocation from Loqa and obsurvations on Ckanural Ob- 

jtsctivus For Ono Student By Period (School 504, Greide 2) . . G2 

10 Average Distribution of Inatructional Days for Peiriods A 
and B and for the Total Period (Schools 452 and 504, 
Grade 5) 65 

19 Percent of Allocated and Available Times and Average Daily 
Time from Observations for Instructional Time Variables 

(School 452, Grade 5) 67 

20 Percent of Allocated and Available Times and Average Daily 
Time from Observations for Instructional Time Variables 

(School 504, Grade 5) 68 



21 Time Allocation from Logs and Observations on General Ob- 
jectives For One Student By Period (School 452, Grade 2) . . 69 

22 Time Allocation from Logs and Observations on General Ob- 
jectives For One Student By Period (School 504, Grade 5) . . 72 

23 Percent Correct for Three Administrations of the Achieve- 



ment Monitoring Tes :s and Gain Score For General Objec- 
tives (School 452, Grade 2) 78 

24 Objective Easiness for Three Administrations of the 
Achievement Monitoring Tests and Gain Score For General 
Objectives (School 504, Grade 2) 80 

25 Harris -Pea rlman Item and Domain Difficulty for Subtest 1: 
Consonant Blends (Schools 452 and 504, Grade 2) 81 

26 Harris-Pearlman Item and Domain Difficulty for Subtest 2: 
Central Thought Topic of a Passage without an Organizer 
(Schools 452 and 504, Grade 2) 83 

9 



<^ viii 



'l\ll> It: IM.).; 

* / liar I i M -I'tiai. I I i t.m ainl Unna \\\ lu i l u u 1 t y I » u Sul»t I ; 

Alt^hahot t/.ilM (;ii:UnoLii SO.l, uiMilti J) »M 

,!H i n vnnumt. ;u'< )ro:i ( i)r 'I'h nu> WDI^.Sl) Htuul ini| Skills; A» 'h in 

uioat: MnnU-m iui) lVni'uui.ai|ii c'i)» r»H;l roi; 'rol (U ilroup aiul 

lX:vUitLon lot'l.Uu Toliil liroup aiul lot Sin 'rar<|til- ;llutU>nlii 

(SuluH)i ^V^:\, cirailn .0 Md 

Auhlovun^JUl :Uh)iou Tor 'riutuj WDliiJD Koruliiuj ,v?killMj At^hiovn- 
muat MoiiLturlih u.'onliiijis C'luroDt. lor I: I us 'Pot^.U. clroap aiul 
I3()niain KisFurunotul Purcuntaqo clorrm.-t, Murin, aiul JittuuLircl 
DoviaLlon for tho Totiil (iroap and for six •l\\rqi>t St,\uloul:M 
(Scliooi [)04, Crado 2) H7 

.JO Objoctivo KasiiioHs tfor Thruo Adminintratlonii of tluj Achiovn- 
ment Monitoriiui ToHtH and Gain Score for Gonorai Objoctivc^iJ 
(School 452, Grade TS) qo 

3L Objective Kasinuus for Three Adnunist rations of the Achieve-^ 
ment Monitoring Tests and Gain Score for General Objectives 
(School 504, Grade 5) 91 

32 Harris-Pearlinan Item and Domain Difficulty for Subtest 1: 
Outlining (Schools 452 and 504, Grade 5) 93 

33 Harris-Pearlman Item and Domain Difficulty for Subtest 2: 
Indirect Clues — Application (Schools 452 and 504, Grade 5) . 94 

34 Harris-Pearlman Item and Domain Difficulty for Subtest 3: 
Conclusions — Indirect Relationships (Schools 452 and 504, 

Grade 5) 96 

35 Achievement Scores for Three WDRSD Reading o-.^iis: Achieve- 
ment Monitoring Percentage Correct for the Total Group eind 
Domain Referenced Percentage Correct, Mean, and Standard 
Deviation for the Total Group and for Six Target Students 
(School 452, Grade 5) 98 

36 Achieveme;. .-ores for Three WDRSD Reading Skills: Achieve- 
ment Monitoring Percentage Correct for the Total Group and 
Domain Referenced Percentage Correct, Mean, and Standard 
Deviation for the Total Group and for Six Target Students 
(School 504, Grade 5) 99 



- to 



1 I '»U I lU .-i! U»u t»tJlWiit!h AVtJtai)Lj Annual i»r All.u.Uei.t flliU: 

All.h'altiil 'Tluui riiMU 'I'ti.t. hiU My 'I'.tpw Aiui Ohjui tiv^i 

t«M wni<;ii) (Si'htit^i , lii i 

I'iM i.'hllit aiul Ai.'lilta'ituu'ul i.aluM I'm Ki),t,ih\i| SKilh li. 

10 Niimbiir of Miiml.uii Al. LoiMt tul .uiil licji inunujiiiloii \\m vicmk 

'1').! .uul , . , . 1 h 



.1. U. .■ (I. 



) .1 1( 



M« 1 . » ' 1 I I I • V ' ■- 1 lU U t . I . M i > J i I ■ 1 . j i M 1 1 • » I 1 > . t . t < ; . I M I . . : 



Abstract 



This report is part of Phase IV of the IGE Evaluation carried out by the 
Wisconsin Research and Development Center for Individualized Schooling. 
IGE (Individually Guided Education) is a complex educational system in- 
tended to enable the elementary school to provide an environment where 
students learn at a rate and in a manner appropriate to their own learn- 
ing styles. Phase IV included five studies, three descriptive and two 
comparative. This descriptive study concerns the implementation of the 
Wisconsin Design for Reading Skill Development (WDRSD) , an instructive 
management system which was created at the R&D Center to be compatible 
with the IGE system. Grades 2 and 5 participated at each school, and 
data were collected through tests on general objectives of the program, 
observations, teacher logs, and interviews. Profiles by school for 
each grade on means of instruction (pacing, grouping, materials, and 
interactions), time use (allocated, nonapplied, available, and engaged 
time) , and achievement provide a basis for discussing the relationships 
among variables. 
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INTRODUCTION 



IGE and the Evaluation Project ^ 

Through the combined efforts of the Wisconsin Research and Develop- 
ment Center for Individualized Schooling, the University of Wisconsin 
IGE Teacher Education Project, the Kettering Foundation (I/D/E/A) , and 
IGE coordinators in 25 States, more than 2,000 elementary schools have 
adopted a system called Individually Guided Education (IGE) , This is 
a complex system based on theoretic and pragmatic ideas about schooling, 
children's learning, ^nd the professional roles of school staffs. It 
was intended to influence elementary schooling in three general areas, 
organization, instruction, and intra- and inter-organizational relations, 
to provide 

an environment in which the individual students learn 
at rates appropriate to each student and in a manner 
suitable to each student's learning style and other 
intellectual and personal characteristics. (Klausmeier 
Rossmiller, & Saily, 1977, p. 7) 

More specifically, as an operating system IGE functions on the basis 
of seven components : 

1. Multiunii-- o r5Ja nization 

Instruction and Research (I & R) unit at the instructional 
level 

Instructional Improvement Committee (IIC) consisting of 

the principal and unit leaders at the school level 
System-wide program Committee (SPC) at the district level 

2 . Instruction a l programming for the individual student (IPM) 
Stating educational objectives 

Estimating tl^e range o£ objectives attainable by subgroups 
of the student population 



Assessing the level of achievement, learning style and 
motivation 

Setting instructional objectives for each child to attain 

over a short period of time 
Planning and carrying out instruction for individual students 
Assessing the attainment of objectives 
Recycling through these procedures 

3 . Evaluation for educational decision making 

Procedures to provide information about the student 
curriculum and overall school program at the 
beginning of a unit of instruction, during the 
instructional sequence, and at the end of a unit 
of instruction 

4 . IPM compatible curricular materials 

Accurate and reliable content 

Statements of instructional objectives 

Suggested instructional activities appropriate to 

varied learning styles, reading levels, and other 

characteristics of individual students 
Record keeping devices and procedures 
Suitable in terms of cost 

5 . Home - s choo 1 - commun i ty re 1 a t i on s 

6 . Facilitative environments 

Intraorganizational environment providing physical and 

material resources 
Extraorganizational environment including state education 

agencies, intermediate educational agencies, and teacher 

education institutions 

7. Continuing research and development 

Thus, IGE has as its goals the instruction of students based on 
their individual level of achievement and learning styles, the develop- 
ment of particular types of organizational relationships within and 
outside of the school, and continuing research and evaluation. 

Although much has been written about IGE as an alternative form 
of elementary schooling, no comprehensive picture exists showing the 
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manner in which IGE has been implemented in these schools. Thus, in 
order to gain a more detailed view of the day-to-day operation and 
effectiveness of the system as a whole, the IGE Evaluation Project 
identifies features which contribute most to the succeLii of reading 
skills and mathematics instruction as a result of individualized 
instruction (Romberg, 1976) - 

The evaluation project, comprised of five phases, was organized to 
provide complementary information on IGE- Phase I was a large sample study 
which provided basic information about IGE schooling- Certain features 
of IGE schooling were reputedly crucial to IGE success- The purpose of 
Phase I, then, was to examine the extent to which those presumab 
essential features had been implemented among IGE schools and to assess 
the effectiveness of that implementation- In this large sample study, 
including over 150 IGE schools, information was gathered from IGE school 
staff members using self-report surveys and from students using standard 
paper and pencil instruments- The data provided a functional under- 
standing of IGE features, processes, and outcomes by relating a broad 
range of variables in an interpretive manner - 

Phase II verified and extended the self-report data gathered in 
Phase I to include more fully the range of variables that determine the 
process of schooling. 

Phase III investigated the social meaning 'i-hich emerges as IGE is 
used on a day-to-day basis- The problem of understanding the impact 
of educational reform can be approached by viewing schools as social 
institutions whose characteristics shape and are shaped by the behaviors 
of their members- This focus allows us to think of a school as a complex 
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social arrangement whose underlying patterns of conduct channel thought 
and action within that setting. 

Since the success of IGE depends heavily on the availability of 
materials and evaluative procedures compatible with instructional 
programming for the individual student, an analysis of curriculum 
products designed to be used in IGE settings was undertaken. This aspect 
of the project— Phase IV— seeks to determine how well the three curricular 
programs developed for IGE meet their objectives, and to clarify the 
relationship of pupil outcomes to instructional time and means of 
instruction. In addition. Phase IV provides information about pupil 
activities and learning outcomes as they relate to specific objectives. 

Finally, the goal of Phase V is to synthesize the results of Phases 
I throv.gh IV and to address the significant issues in contemporary 
schooling raised by the project as a whole. Each phase of the evaluation 
was designed to complement and strengthen the validity of the data 
gathered by the previous phases. For example, data on means of instruction, 
gathered by the large-sample study in Phase 1/ are examined in somewhat 
greater depth in fewer schools in the Phase II studies. Phase Ill's 
analysis develops a view of instruction from a different perspective. 
Phase IV explores means of instruction within the specific curricular 
areas of reading and mathematics. Instead of merely adding together 
summaries of the different evaluation phases. Phase V is designed to 
integrate and interpret the data from all the phases into a series of 
statements of the project's implications for educational issues. 
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Overview of Phase IV 

The intent of Phase IV was to describe in detail the actual operations 
of a sample of schools using curriculum materials designed to be compatible 
with IGE. Phase IV investigated three groups of variables— pupil outcomes, 
instructional time, and means of instruction— in IGE and non-IGE settings 
in which the Center's curriculum program as well as alternative curriculum 
materials were being used. Pupil attainment of program objectives is the 
dependent variable. The other two variables, instructional time and 
means of instruction, are essential in explaining and understanding 
how the programs work and how objectives are obtained. Instructional 
time was included because recent studies and reviews stress its impor- 
tance and its relationship to pupil outcomes (Harnischf eger & Wiley, 1975; 
McDonald & Elias, 1976; Rosenshine, 1977). As Harnischf eger and Wiley 
state, "All influences on pupil achievement must be mediated through a 
pupil's active and passive pursuits" (p. 15). Instructional time and 
uses of instruction variables are also important from a practical point 
of view because they can be manipulated by teachers: Describing the use 
of each program in terms of allocated time, engaged time, and instructional 
activities provides concrete factors that teachers can manipulate in 
preparing and conducting instructional activities. The structural 
relationships among these variables are illustrated in Figure 1. 
In sum, the primary purposes of Phase IV are: 

1. to determine the degree to which the Wisconsin Design for 

Reading Skill Development (WDRSD) (Otto, 1977), the Pre-Reading 
Skills program (PRS) (Venezky & Pittelman, 1977), and Developing 
Mathematical Processes (DMP) (Romberg, 1977) , meet their 
objectives and skills. 
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2. to determine how time is allocated for instruction in 
implementing WDRSD, PRS, and DMP. 

3. to relate instructional time to the means of instruction 
and mastery of content for WDRSD, PRS, and DMP. 

4. for each curriculum program, WDRSD and DMP/ to contrast two 
situations — IGE schools using the program with non-IGE 
schools using the program and IGE schools using the program 
with IGE schools using alternative programs — on the variables 
of pupil outcomes, instructional time, and means of instruction. 

Five studies were conducted as part of Phase IV, three descriptive 
studies and two comparative studies. The descriptive studies were small 
sample studies designed to describe how each of the three curriculum 
programs were being used in IGE schools. Each study was conducted from 
January to May 1978 at two IGE schools using DMP, two IGE schools using 
WDRSD, and three IGE schools using PRS. A more detailed description of 
the two WDRSD schools is provided in the following section of this paper. 
Achievement monitoring and domain referenced tests, observations, teacher 
logs, and interviews were used to collect the data. These procedures 
were piloted for subsequent use in the comparative study. A more detailed 
description of the design for the descriptive studies is given in 
Project Paper 79-42 (Webb & Romberg, 1979). 

Data were gathered for the two comparative studies from CX:tober until 
May during the 1978-1979 school year. Three types of schools were 
included in these studies: (a) IGE schools using DMP or WDRSD; (b) non- 
IGE schools using DMP or WDRSD; and (c) IGE schools using alternative 
programs. Four triads of schools were selected for WDRSD and three 
triads for DMP with each triad containing one school from each of the 
three cells just mentioned. Only students in grades 2 and 5 and their 
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teachers participated in the study. As in the descriptive studies, data 
were collected by four means: tests on general objectives of each 
program, observations, teacher logs, and interviews. 

Overview of Remaining Sections 

This report deals with the WDRSD descriptive study. Following an 
outline of the WDRSD curriculum program and a sumn\ary of the data 
collection procedures, a description of the two schools which participated 
in the study is provided. Grade 2 and grade 5 profiles by school for 
the means of instruction (pacing, grouping, materials, interactions) , 
time (allocated, nonapplied, available, engaged), and achievement 
variables are considered in subsequent sections. The report concludes 
with a discussion of the relationships among the time and achievement 
variables . 
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II 

PROCEDURES 

This section provides an overview of the procedures used in the 
descriptive studies. The description of the WDRSD highlights important 
features of the curriculum program which distinguish it from other self- 
^ contained or record-keeping systems. Because data on the content of 

instruction were obtained from several sources and then combined for 
analysis, a list of the reading skills at each level of aggregation is 
included, followed by a description of the data collection procedures 
themselves . 

The WDRSD Program 

In order to better understand the observation, log, and testing 
procedures, a brief introduction to the Wisconsin Design for Reading 
Skill Development (WDRSD) may be helpful. The WDRSD is an objective- 
based system that provides both structure and substance for an elementary 
school reading program. The focus is on developing the essential subskil 
of reading, which once acquired and applied enable students to read 
successfully. The WDRSD has four fundamental purposes: 

1. to identify and describe instructional objectives for the 
skills which appear essential for competence in reading. 

2. to assess individual pupils* skill development status. 

3. to manage instruction of children with different skill 
development needs. 

4. to monitor each pupil's progress (Otto & Askov, 1973). 

The WDRSD provides a framework for teaching reading skills as the basis 
of a curriculum in which individual differences in students' rate and 
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style of learning are emphasized. This organization of instruction includes 
five major operations: 

1. identification of a list of essential reading skills, with 
consensual, historical, and/or empirical support; 

2. statement of objectives specifying the criterion behaviors 
related to each skill? 

3 . assessment of children to determine who has or has not 
already mastered each skill; 

4. identification of appropriate materials and activities 
for instruction in each skill; and finally, 

5. evaluation of learning. 

Based on these operations, the following material components for the 
WDRSD curriculum program were developed: 

1. descriptions of the skills which appear essential for competence 
in reading; 

2. assessment instruments for determining students' skill strengths 
and weaknesses; 

3. management guidelines for skill instruction, grouping, 
testing, and monitoring; 

4. sample instructional activities to develop the skills; and 

5. evaluation guidelines. 

In the skills and objectives component, six areas of skills have been 
identified: Word Attack, Study Skills, Comprehension, Self-directed 
Reading, Interpretive Reading, and Creative Reading. Behavioral objectives 
were written for each skill in the first three of these six areas. 
Assessment exercises and teachers' resource files accompany each of these 
objectives. The skills in the other three areas are not behaviorally 
described and assessment exercises are not included. Skills in each of 
the six elements are clustered at levels that correspond to traditional 
grade levels, as shown in Table 1, in order to facilitate initial 
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Table 1 

WDRSD Skills by Element and by Traditional Grade Level 



Skill area 



Grade 





K 


1 


2 


3 




4 


5 




6 


Word attack 


A 


B 


C 


D 












Comprehension 


A 


B 


C 


D 




E 


F 




G 


Study skills 


A 


B 


c 


D 




E 


F 




G 


Self-directed reading 




A-C 






D-E 






F-G 




Interpretive reading 




A-C 






D-E 






F-G 




Creative reading 




A-C 






D-E 






F-G 
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implementation and to help in general skills assessment and regrouping. 

Formal tests of demonstrated reliability which are suitable for 
individual or group administration and which aid in the preparation of 
skill development profiles have been developed for most of the skills in 
word Attack, Comprehension, and Study Skills. There are two available 
forms, Form P and Form Q. The forms are parallel and may be used inter- 
changeably . 

Each test is keyed to a specific objective, and tests are available 
in two formats: separately for a single skill, or in booklets which 
include all the skills at a given level. The tests are criterion 
referenced and generally machine-scorable . Certain skills which could 
not adequately be assessed with paper and pencil tests are assessed with 
individually administered performance tests. 

content Aggregations 

In the descriptive ^tudy of Phase IV, information on the content 
taught during WDRSD reading skills instruction was obtained from the 
teacher logs, classroom observations, and achievement monitoring tests. 
These data were grouped for analysis at three progressively more specific 
levels. The most inclusive is the "content area," followed by the 
"general objective" and the "specific objective." 

As outline in the WDRSD (Otto, 1977), reading skills may be organized 
into three content areas: Word Attack, Comprehension, and Study Skills. 
Within each of these content areas, from one to six general objectives 
and the specific objectives which they represent are described below. 
The grade 2 Word Attack, Comprehension, and Study Skills aggregations are 
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shown in Figxires 2, 3, and 4, and grade 5 aggregations are outlined in 
Figures 5, 6, and 7. A more detailed explanation of the WDRSD skill 
levels and objectives which were included in each aggregation is pro- 
vided in Project Paper 80-1 (Nerenz & Webb, 1980) . 

Data Collection 

Tests. Two types of tests were used to measure pupil outcomes for 
this descriptive study. Information on achievement was obtained at three 
different times using achievement monitoring procedures. This procedure 
provides a means of assessing achievement on a large number of skills at 
several points in time and yields more information on the growth of 
groups of students than would be obtained by a simple pretest-posttest 
design. Generally, test items from WDRSD skills tests Forms P and Q 
were selected and assigned to test forms using matrix sampling techniques 
such that the set of two to four items testing the different WDRSD skills 
were divided among four test forms. During each testing, one-fourth of 
the pupils were given each form so that each pupil was tested on only 
a portion of the entire set of reading skills at a time. In this manner, 
data were obtained for the group on a large number of skills with 
minimal disruption of normal classroom activities. 

The second testing procedure, domain referenced testing, was used 
to obtain information on all students for a small numi^er of reading 
skills. Three objectives at each grade level were tested. Using an 
operational definition of the reading skill specifying exactly what 
content composed the domain, items were selected or created and assigned 
to a test form. The same form was administered to all pupils. Details 
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f .«iner*l Objective 
Number Descriptor 
"•1 t'h'jniL Anal ygi s--CcjnsDndntb 



Phonic Analysis--Vf>weis 



"J^ Phoni'- Analysis — Silent Letters 

■'»4 Structural Analysis 



Vocabulary Meaning 



Specific Objective 
Case Number Descriptor 

01 Beginnintj and Endinc] 
Consonant Sounds 

02 ConsonjnC Blends 

f33 Special Cdniiondnt itjundti 

05 Short Vowtl:. 

ri(i iJ{,('ciiil Vowel .;oiuuls 

07 Silent Letters 

08 Possessivcs 

10 Word Structure 

11 riurals 

12 Ccmtracrtions 

13 Word Analysis 

14 Special Meanings 



201 b i 

202 b 4 

20i h 5 

:oB C 3 

22A D 2 

201 C 2 

Jll C12 

209 C 4 
21A C 9 
215 CIO 

210 CU 

213 C H 

210 L- 5 

211 (. 

212 C / 
ill D U 

225 D 3 

317/205 Bli 

227 D 7 

204 B 6 

339 b 9 

346 BU 

2lB C13 

219 C14 
31G BIO 

226 D 4 
320 D 5 

220 CIS 

221 C16 
22T cie 



bv<3iniiin>'j consujiant souuda 
CtkdinQ coiisunant s&uiid:: 

Two-lutter consonant blt-nd^i 

Hore difticult two*lfttt?r L"ufiL.i't.,u.i Llnni. 

Three-lftter C.'jnaonant blcnJi". 

Consonants and their variant ui-u:h1j 
Common consonant digrjpn;; 

Lung vowul suunds 

Silent e ijenera liajtion 

Two vuwelb tOfjethor c^entra liijt aljII 

Final vowel ^ertt^ral iza tian 



bhort 



rl genera lizal 1 



riu. w 



al Word Attack Skills 



20b C 1 
222 C37 



Vfjwi' 1 pi Ui> r , J I'lu! 

1)1| .tlthulllj-j L-W. I'l, L 

Ia>U) .lllJ '<>(Urt inj 

Silent lettert. 
PoiiseiiSi ve forms 

More difficult j osscjL. ive form:* 

Hhyming elemental 

Compound words 

Dase wordb and c-njingu 

Base words with prefixes and sutfiAC'j 

More difficult plural forms 

Contractions 

Syllabication 
Accent 

Hcxnonyms 

Synonyms and ar.toniTns 

Chooses appropriate meaning of multlple- 
merininq words 

Has sight word vocabulary 
Has independent und varied word aLta^k 
skills 



Figure 2. Grade 2 WDRSD word attack content aggregations. 
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".enaral Objective 
C««a Nufnb«<r D«acrlptor 

Passage Meaning Skills 



Q7 f^entence Moaning Skills 



OH Word Meaninrj i;itills 



09 Gfjn»?ral Reading 



Specific Objective 
Case Niunber Descriptor 
16 Central Thought 



21 

2 2 



raraphr>mi.> 

Word Parts 
Context Clups 

General Koaiing 



Case-Skill 



D«acr iptor 



330 


U 




Identifies a topic: With urijaiuZt:! 


241 


c 


3 


Identifies a topic: Without (jrtjani Zlt 


304 


E 


5 


Identifies central thoughts With 








organ izer 


3J6 


U 


3 


Predicts outcomub 


302/242 


c 


4 


Identifieb concl usi onti > One rt.'lJtioii;>t 


327 


D 


5 


Identifies cause-effect re lationahipii 


318 


E 


b 


Identifies conclusions: Uireit 








relationbhips 


3J2 


U 


4 


Identi f les event : Before 


132 


U 


5 


Identifies event: After 


243 


C 


5 


Determines sequence: Event bvjiurc of . 


308/309 


F 


6 


Determines sequence: Implicit cluci; 


308 


G 


Q 


Determines sequence : Impl led and stati 








events 


334 


B 


1 


Derives meaning from sentence si: Notes 








detai 1 


303/2 39 


C 


1 


Notes detail in positive and negativtf 








sentences 


331 


D 




Notes detail in active and payuivt; von 








sentences 


340/240 


C 




Paraphrases positive- and n(.><]ativc; senti 


341 


D 


J 


Paraphrabeo active and pass,ive voice 








sentences 


337 


r 


1 


Identifies word parts: J;uf fixes 


105/321 


0 


1 


Determines word moaning: liU-nt i f lis 








direct context cluen 


244 






Creative reading 


245 






Interpretive reading 


240 






f.elf-directed reading 


247 






Silent reading 


301 






General comprehenu ion 


306 






Oral reading 


307 






Enrichment 


343 






Basal reader 


344 






Laitguaqe arts 



Figure 3, Grade 2 WDRSD comprehension content aggregations. 
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Goncral Objective 
Casr Huinb<*r Df.':-.f r iptor 

10 M.si, .Skills 



Specific abjectly*. 
Cdae Number Descriptor 
24 Representation 



Orientation 



Oiaph and Tablfi Skills 



Measurement 



Case-SKil 1 Descriptor 

33B B 1 Uues picture sytnbolii to interpret nup& 

22B C 1 Uses a key containing nojipictur lal :iyTTU..ulb 

interpret map& 

22y C 2 Uses a color koy to interpret mapii 

230 C 3 Locates points on simple picture gricts 

3:?ti Li 2 Indicates cardinal directions on 'jlobuH 

333 D 3 Oetertnines relative distances 

2 31 C 4 Compares sizes 

232 C 5 Expresses relative distances 

2J3 c 6 Extracts directly 

2l4 C 7 Determines differ»;nces between numbers 
extracted 



2 35 C 8 
JJ6 C 9 



Compares amounts; 
Locates celly 



Fffc?rfn;-i« 5killn 



30 
31 



Alphabctizinc) 



Dictionary Skills 



Locating Infornatiun in 
Books 



238 Cll Applies basic alphabet i ziny skills 

321 DlO Applies alphabetizing skills 

345 Dll Uses guide words in simple rtjfcrcnrc bonks 

322 E12 Uses guide words and guide letters 



32 3 D 0 
335 E 9 



237 clO 
325 D 9 
328 D12 



Has beginning dictionary and glossary skillii 
Uses dictionaries independently 



{^velops book skills 

Uses tables of contents 

Uses headings and sub-headings 



Figure 4. Grade 2 WDRSD study skills content aggregations. 
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General Obiective 




Specific Objectiva 






C4s« riiBnb«r 


Descriptor Case Niunber 


Descriptor 


Caiu-SKill 


Deicr iptor 




Phonic Analy 3i3--Consonant5 


01 


Consonant Blends 


403 C 3 
251 D 2 


Two-letter consonant blends 
Throe-letter consonant blends 






02 


Special Consonant Sounds 


4 02 C 2 
412 C12 


Consonants and their variant saundu 
Common consonant digraphs 


02 


Phonic Anflly3is--vowel 3 


03 


Long Vowels 


404 C 4 

409 C 9 

410 CIO 

411 Cll 


Long vowol sounds 

Silent e^ generalization 

Two Vowels together generalization 

Final vowel generalization 






04 


Short Vowel« 


40U C B 


Short vowel generalization (middle vuwel) 






OS 


Spec i a 1 Vowel Sounds 


40j C ') 

406 C 6 

407 C 7 
422 D 6 


Vowel plus £, a plus 1_, a plus w 
Diphthongs ew, oit uu< ow 
Long and short oo 
Schwa 




Phonic Analysi3--Silent Letters 


06 


Silent Letters 


252 D 3 


Silent letter^ 


0-1 


Structural Analysis 


07 


Possessl ves 


2'^3 D 7 


Possessive for ins 






OU 


word Structure 


413 C13 


Base words with prefixes and suffixes 






09 


Plurals 


414 C14 


More difficult ]>lural forms 






in 


Word Analysis 


476/420 D 4 
421 D S 


Syl labicatiun 
Accent 




Vocabulary MR<3ninrj 


11 


Special Meanings 


415 CIS 

416 Cl& 
410 C18 


Homonyms 

Synonyms and antonyms 

Chooses appropriate meaning of multlplo-moanu.g 
words 






12 


General word Attack Skills 


401 C 1 
417 C17 
419 D 1 
2B7 


Has sight word vocabulary 

Has independent and variud word attack LikilLs 

Has sight word vocabulary 

Vocabulary 



Figure 5. Grade 5 WDRSD word attack content aggregations. 
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r>engral Objactive 
C««*» Number Descriptor 

i>'j P\3sjq« Moaninrj 1 1 1 s 



Specific Objective 
Case Number Descriptor 
13 Central Thau,]ht 



5t«ntcnc« Meaning Skills 



Word M*^a^ing Skills 



C.»?nerrtl Reading 



Paraphr<»ae 



Word Parts 



19 Context Clues 



General Readiny 



Cdse-Skill 

450 E 5 

279 F A 

AAA DC Dl 

456 DC Fl 

AAt C A 

452/465/460 E 6 

290 F 5 

460 DC F3 

461 DC F4 
466 DC G3 

464/470 E 7 
445/451/2ai F 6 

457 G B 



44B D I 
453 E 4 
46J/27B r i 



455 E 1 
463/276 F 1 
471 G 1 



454/277 F 2 
46B G .1 

2B2 
2B3 
2B4 
2B5 
2B6 
2BB 



Dtiscr iptor 

Identifies central thought: With or tj. uii/.tjr 
Identifies central thought: Without .ir<).im zot 
I dent i f les a tojiic sentence 
Identifie*: <i main idoat Two ijaraijraiiiis 

Identifies conclusions: One r elat.ionahi|. 
Identifies conclusions: Direct rel.iticifi:ihi| 
Identifies concluHiona: Indirect relationuhijJL 
Reasons deductively: Three premiaes 
Recognizes an instance of a principle 
Reasons inductively 

Determines sequence: Explicit clues 
Determines sequence: Implicit clues 
Determines sequence: Implied and stated uventi; 

Notes detail in sentences with more ih.tn unc 
subordinate clauutr 

Paraphrases active attil p-i'iiiive voii-f i.i-uteiu 
Paraptirascs cumi'lex .si.;rit ».'nc e.s 
Paraphrases complex senti.-riLiiii with twu 
mure prepositional phraiieu 

Identifier word parts: Prefixes 
Identifies word parts: Suffixes 
Identifies word parts: Combining forme 

Determines word meaning: Identifies direct 

context clues 
Identifies indirect context clues: Application 
Identifies context clues: Obscure* meanings 

Creative reading 
I ntcrpreti ve reading 
Self-directed reading 
silent reading 
General comprehens ion 
Enr ictiment 



Figure 6. Grade 5 WDRSD comprehension content aggregations. 
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c;«nef 1 ob \ net ma 

C.tfus Numt'ftr fieucrlptor 



'^Vcidc Ubjecuve 



Kefercnce Skills 



nu NtUiibur 


Deacriiitor 




■Skill 




J I 




J 'i-l 


[1 \ 


UijL'ij I'litnt UIIl) llllt! ililubnlLj tlj llllfljli't 








V I 


Uji*Li j'Ltihti lint.'i ttitil jcuit ii ynitivj 1 !i 




















u Im 1 lar it it<!i and Uif furciiiLM.'u 


22 


Driont.ition 


•12 J 


D 2 


cardinal direct lun^ oik . lube. 








E 


Dutt-rmno'-'^intarmt'dia^ un^ ilubt ••. 










tJiu unvi rorunu n 1 1 u i lU oj\ lujp y 








F 


Useii various projection. 


23 


Koasurcmcnt 


424 


[1 3 


Usos b^ali.- to dtiturtninu whulc unit^ ui diLiianut' 






25b 


E 3 


Hakes 1 inn tod usu of scale to deterinifte di'ittifi.re: 








F 3 


Uses inset naps to detertninc reldUivt' !ii^(:i> 










of area^ 






267 


F •! 


Comparesj maps drawn to different Sjcalcs 


24 


Graihs 




D 4 


Dotcrtniritis differences between nuniLfri« trxtr 1 lul 






255 


D 5 


Extracts hy interpolating 






'135 


L 4 


Utitertninus differences betwei^n imirlii ; *. i:xtra- tfil 






259 


E 5 


Deter ml neb purposes and makes siuiunui y tj tiitt-'Pii-'nt^i 






26H 


F 5 


Determineb differences between nLU^^b^-rij ex true ted 


25 


Tablea 




D 5 


Petnrmint^s relationsHips between e'ulls 






436 










4 37 


E 7 


Petormlnes purposes and makes sununary statccn^Mit^ 






269 


F 6 


Detei'mines relationships be two en e'tillo en 










schedules 


2L 


Alphabet izing 


430 


DlO 


Applies basic alphabetizing skills 






431 


DU 


Uses guide words in simple reference buoku 






440 


El 2 


Uses guide woirds and guide letteri* 


27 


ic loritiry i s 


42a 


D y 


Has beginning dictionary and qlosaary L.killti 






261 


E 9 


Uses dictionaries i ndepwndon 1 1 y 






271 


F B 


Uses diet ionar ieo for prooune'idt ion 




Locating Information 










Books 


427 


D 7 


begins to use indexe's 






•129 


D 9 


Uses tables of contents 






432 


Dl2 


Uses headings and sub-headings 






260 


E B 


Refines use of indexes 






43B 


ElO 


Uses cross references 






439 


Kll 


Uses a variety of sources 






270 


F 7 


Uses Subject Index 






275 


F12 


Uses information on catalt>c| cdrUij tu bt-le'e-t 










material 


J** 


Locating Sjiocicilizod 










Inf ormat i on 


262 


L13 


Uses guide cards 






442 


E15 


Selects speeialized reference books 






272 


F 9 


Appl ies card filing rules 






273 


Flo 


Uses Dewey Decimal System 


30 


Pccording 


441 


E14 


Takds notes 






274 


Fll 


Has beginning outlirking skills 


31 


r.valuat i on 


433 


D13 


Selects relevant sources 






4 34 


D14 


Recognizes printed stLitRtnents may be fjet or 










opinion 






443/263 


E16 


Considers special features of books 



Figure 7. Grade 5 WDRSD study skills content aggregations. 
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on both testing procedures are provided in Project Paper 79-29 
(Dunham, Nerenz, & Webb, 1979) . 

Observations ■ The Phase IV observation system was modeled after 
the one used in the Beginning Teacher Evaluation Study (Marliave, 
Fisher, Filby, & Dishaw, 1977) and was designed to describe how WDRSD 
was being used. In particular, the observation system used time as a 
metric to describe how the curriculum program operates to facilitate 
student achievement of the objectives of the program. The categories 
used in the observation system were : 



Nonapplied Time - - - - time devoted to other than the 

curricular program being observed 

Specific Content- - - - reading skill 

Pace- --------- whether or not the student is working 

at his or her own pace 

Grouping- ------- size of group of which the student is 

a member 

Materials ------- the materials being used by the student 

Learner Moves ----- student engagement or nonengagement 

Interaction ------ persons with whom the student is 

interacting and the direction and 
focus of that interaction 



This procedure involves the observation of a single "moment" within a 
longer period of time and the recording of the "event" that took 
place during the instant. Briefly, a sample of six randomly selected 
target students was observed in a cycle of approximately three and a 
half minutes. For the first target student, the observer took a 
"snap shot" of what the target student was doing at the beginning of 
the cycle. The student activity at the instant of observation was 



recorded on the form by filling in the appropriate categories. Then 
t'\e next target student was observed for a moment and his or her 
activity coded. The procedure continued until all six target students 
hacl been observed , which took approximately 3 minutes . Thirty 
se.onds were then taken to record the major role of the teacher (s) and 
general activities occurring in the classroom. This cycle was re- 
po Led, observing each target student in sequence and recording 
general comments, during the time allocated for work on the curriculum 
prcgrai.i. A more detailed description of the observation procedures is 
provirled in Project Paper 79-32 (Webb, 1979a). 

Logs . For the WDRSD descriptive study, logs were maintained for 
a sconple of six target students at each grade level in order to 
o,^-aiu a measure of the total time allocated to instruction on specific 
objectives during the investigative period. These logs were completed 
by the teachers who were directly responsible for instruction. On 
the logs, the amount of time allotted to instruction on each reading 
skill, the size of the group with which the target student was working 
during instruction, and the type of materials being used were recorded. 
A more detailed description of the logs and logging procedures is 
provided in Project Paper 79-31 (Webb, 1979b) . 

Interviews. Interviews were conducted with at least one teacher 
at grades 2 and 5 to obtain information on a small number of background, 
organizational, curriculum, and instructional variables. Transcripts 
and summaries of these data are available in Project Paper 79-30 
(Nerenz, 1979h) . 
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DESCRIPTION OF THL: SCHCX3LS 



The WDRSD descriptive study of Phase IV was designed to provide 
detailed information about instruction in reading skills at grades 2 
and 5 for two schools. Both schools began using the WDRSD in 1971 and 
implemented portions of the program at each grade level. They were 
selected to participate because of their differences in demographic 
setting and operational features as well as their utilization of the 
curriculum program itself. In this section of the report, background, 
organizational, program use, and initial achievement variables are 
compared for each of the two schools . 

Demographic Background 

School 452 is one of seven elementary IGE schools using the WDRSD 
in a middle-class midwestern community of approximately 6,000 people. 
This community would be classified as a "small place" using the 
categories of size and type of community suggested by the National 
Assessment of Educational Progress (NAEP) ; the principal occupations 
included farming or small businesses and industries. The staff of 38 
teachers, aides, and specialists worked with a total of 519 students 
in three multiage/grade units during the 1977-78 school year. 

In contrast, school 504 is one of three public elementary schools 
located in a suburb of Minneapolis classified by NAEP as "urban 
fringe." In the district, it is the only IGE school as well as the 
only elementary school to implement the WDRSD. The community includes 
both professional people who commute to Minneapolis and farmers who have 
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livod in or near the town for many yoavH, 30 that thu obsorvur doHcribad 
tho town afj havLncj a "rural influonuu and l)ac;k(jround an well. a.s a 
metropolitan attitude," The 500 students at school 504 were involved 
with 39 staff members and were organized into four multiage, cross- 
graded units- 

IGE Characteristics 

Information on the schools ' implementation of portions of the 
seven basic components of an IGE system was obtained using four 
variables developed from the Fhase I self -report questionnaires. 
These variables are defined below. 

The first variable, Interorganizational Relations (lOR) , measures 
the school's interrelationships and activities with persons and organi- 
zations outside of the school, especially those believed to facilitate 
implementing and maintaining IGE, lOR deals with the role and 
frequency of meetings of the School Program Committee (SPC) , school 
involvement in a network of IGE schools, and community relations, 

Intraorganizational Structure (lOS) measures aspects of the school's 
internal organization which are relevant to implementing IGE, 
Organizational structures within the school (Instructional Improvement 
Committee, Instruction and Research Units, etc.) are assessed for 
characteristics such as membership composition, frequency of meetings, 
permanence of leadership, amount of release time made available for 
meetings, whether parents and others participate in the group's 
activities, whether agenda of meetings are kept, and how agenda are 
distributed. The existence and responsibilities of certain supplementary 
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Mtalrl: po.^jLtionM (XMC dlroctorM, Ml.wdtinl: Coachorn, a.uluM, and Int.uKnii) 
an.j alMo aiisoHMcul as ]>atM. ot: Uhu i nltir.na.l orMan.l /.at loa uf l.lui ju.'honl. 

Tha third variable, Procoduroa Koator Lng Coordiaation and 
TmE^rovomont of tha School Program (GOS) , is a maanuro that includos 
research and development, staff development, use of volunteorM ai\d aidoji, 
noninstructional (advisory) contact between teachers and students, and 
other aspects of home-school-community relations. 

General Implementation of the Instructional Programming Model is 
a measure of implementation of general school practices that have been 
encouraged by the Wisconsin R&D Center as supportive of the Instructional 
Programming Model (IPM) . It is developed from the seven steps in the 
IPM: (a) setting school-wide instructional objectives; (b) adapting 
school-wide objectives in each unit; (c) preassessment ; (d) setting 
objectives for the individual child; (e) instruction; (f) evaluation 
of instruction; and (g) overall program assessment. 

The mean for the Phase I sample of 156 schools, scores for schools 
452 and 504, and the percentile of these scores in the Phase I sample 
are shown in Table 2. As Table 2 indicates, school 452 ranked high in 
"IGE-ness," being in the 90th percentile for 2 of the 4 scales 
under consideration. Scores at school 504 were generally close to the 
mean for the 156 Phase I schools. ^ 

Pr^o qram Use 

Program use scales were developed to measure, first, the degree 
of implementation of the different material and management components 
of the WDRSD and, second, the extent to which these materials were 
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Moan, Scora, and PBrcunUilo tor 
Four Phatio I Quoationnairo varlabloM 
for Schoola 452 and 1304 





156 Phase I 
schoola 


School 452 


School 504 


Variable 


^4ean 


Score 


Percentile 


Score 


Percentile 


lOR 


17 


27 


94 


13 


30 


lOS 


20 


25 


97 


24 


79 


GOS 


57 


62 


66 


57 


52 


IPM 


62 


73 


83 


63 


46 
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tniutomUwl In onbii; to mool. LiKllvidiuU iih i UlrtJn ' m luuuhi. Thouu tii.'aluri 

Avtu;au«^^* '^^^'^^ arcuUuj at: two {j(:l\o(.)lt.J aru pt'OMonlnjcl In 'PabltJ ;\ , 

At: uohoul at t\\o oLhor public: altMUenUary licliouUi in l:l\o 

diatrLnt, all throo olomQnts ot^ tho WDUSD wuru imp lumen tiGcl at both 

fjrado 2 and grade 5, although the emphasis on particular aapacts oC 

thc3 program* more nearly matched that of the dovolopers at grade 2. 

In addition, more attention was reported to be paid to meeting individual 

needs at grade 2 than at grade 5. The WDRSD was not fully implemented 

at either grade at school 504 and one teacher noted that 

The staff as a whole .needs to make a commitment to 
either go all the way and use the Design / use it 
regularly and consistently throughout, or else come up 
with a different or a better idea. (Nerenz, 1979h, p. 97) 

This statement is reflected not only in the use of only one element at 

each grade level but also in the mismatch of implementation to that 

recommended by the developers. 

Initial Achievement 

Scores from the first administration of the achievement monitoring 
tests were aggregated into 12 general objectives at grades 2 and 5 and 
percentages correct are reported by grade for both schools in Table 4. 
As shown, scores at school 452 are generally higher than those at 
school 504- Thus, for many of the general objectives, it is clear 
that initial levels of achievement were not the same at the two 
schools—a fact that should be considered when interpreting differences 
in means of instruction, time allocations, and subsequent achievement 
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Table 3 



Scores on the Program Use Scales 



Curriculum implementation Customizing 





Word 
attack 


Study 
skills 


Compre- 
hension 


Other 


Teacher's 
resource 
file 


Total 
(30)3 


Adapta- 
tions 


Review 
and 

reinforce- 
ment 


Teacher- 
made 
Materials 


Total 
(9)* 


School 452 






















Grade 2 


12 


6 


5 


0 


2 


25 


3 


2 


1 


6 


Grade 5 


2 


8 


8 


0 


2 


20 


0 


0 


1 


1 


School 504 






















Grade 2 


5 


0 


0 


0 


2 


7 


5 


0 


1 


6 


Grade 5 


0 


8 


0 


0 


0 


8 


0 


0 


1 


1 



Maximum possible points in parenthesis. 
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Table 4 



Percentage Correct for Initial Achievement for 12 
General Objectives 



Grade 2 Grade 5 



General 
Obj ective 


School 452 


School 504 


School 452 


Scnool 


1 


89 


83 


66 


79 


2 


58 


54 


- 


- 


3 


53 


42 


55 


29 


4 


58 


42 


70 


68 


5 


58 


52 






6 


63 


60 


71 


58 


7 


83 


73 


80 


64 


8 






60 


49 


9 










10 


71 


63 


58 


54 


11 


41 


29 


67 


59 


12 


63 


67 


51 
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IV 



MEANS OF INSTRUCTION PROFILES 

As part of the WDRSD descriptive study of Phase IV, information 
on the particular classroom procedures and materials used during WDRSD 
reading skills sessions was obtained from time-sampling observations 
of six target children. Specifically, four means of instruction 
variables were considered — pacing, grouping, materials, and 
interactions. Detailed descriptive information may be found in 
Project Papers 79-16, 79-19, and 80-1 (Nerenz, 1979a, 19791; Nerenz 
& Webb, 1980) . In that the means of instruction are discussed in 
terms of four different kinds of classroom time, the time variables are 
defined below: 

Nonapplied time - - - the time within a class period that is 

spent in activities not directly related 
to reading skills instruction (wait, 
transition, management break, nonacademic, 
other-academic) 

Available time - - - - the amount of time which is actually 

available for instruction once nonapplied 
time is subtracted from allocated time 

Engaged time ----- the amount of time which students spend 

actively learning the designated content 

Nonengaged time- - - - the amount of time during which students 

are not actively engaged with the content; 
the sum of the engaged and nonengaged time 
is equal to the available time 

Summarizing that information, this portion of the paper develops a 

series of means of instruction profiles focusing on differences among 

individuals within a grade and differences between the same grade at 

the two schools. 
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School 452, Grade 2 

Over the 17-week investigative period, a total of 18 40-minute 
classroom observations were conducted at school 452 — 10 during period A 
(weeks 1 through 8) and 8 during period B (weeks 11 through 17) . 
Because Word Attack and Comprehension or Study Skills were both used 
daily, and since children were regrouped approximately every 2 weeks 
within each element of the curriculum program, over the total period 
a large number of children, 20, were observed. In addition, some 
children received instruction in both elements on a given day, others 
in only one. Thus, data were obtained for 6 to 10 children during 
each observation day. While this type of implementation of the WDRSD 
program reflects attention to individual needs across curriculum 
elements, it is difficult to systematically analyze differences among 
individuals on a day-by-day basis. The data discussed below are 
generally reported only for the total period and for periods A and B 
for each of the means of instruction variables. 

Pacing and grouping . As shown in Table 5, grade 2 reading skills 
instruction was generally conducted in large group settings and paced 
by the teacher, with students working individually and determining the 
speed with which they would progress on a given task less than 25% of 
the available time, or about 6 minutes each day. This pattern holds 
for the observation periods and for many of the individual observation 
days, although there is considerable deviation from this manner of 
pacing and grouping during several of the class sessions, as shown in 
Table 6. Small group instruction was seldom used, accounting for less 
than 1 minute per day over the total period. Detailed information on 
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Table 5 

Percent of Allocated and Available Times and 
Average Daily Time from Observations for 
Means of Instruction and Interaction Variables 
(School 452, Grade 2) 



Period A (10 days) 



\ of 

dl located 
time 



\ of 

.3va liable 



Average 
dally 
time per 
student 
(minutes) 



Period B (B dayy) 



\ of 

al located 
time 



AvL'r.ttjt! 
ddi ly 
titnu per 
studont 
(minut us) 



Total Period 



\ of 

a I locatud 



* of 

aval 1 able 
titnu 



Avcrayy 
da I ly 
time J -or 
studont 
{minutes) 



So If 
Othr-r 



rndiv t -.In. 1 1 

5;m,iil 

I^irT'- 



Pacing 



Grou^mia. 



P>i}/«ir and fjrTifil 



Mjnlpul-i 
Oth»;r 



Iiitt.'ractions 



T.irift -*Tfachfr 

Teatrhpr — •■Tar'jpt 

Ta r qo t-«*- S t ude n t 

Tan#*t: or Student 
— ♦■qroup 

T^'ac^w.•r Group 



Mote. Avnraqe time per clasa djy i-i 4i) mimitcj. 
0+ desiqn.^tps a value loss than . ""i . 



0 
0 



1 

0 

1 

4 
16 



2 
0 
1 

6 

2h 
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Table 6 

Variation by Day in Other Paced and 
Large Group Instruction 



Percent of time 





Other-paced 


Large group 


Observation day 


instruction 


instruction 


4, 13, 14 


100 


100 


16, 17 


65 


65 


5 


48 


49 



47 
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variations among students is not reported here for grade 2 at school 
452 (see Nerenz , 1979i) . It appears from the 4 days on which only 
six children were observed (days 2, 4, 5, 13) that, with the exception 
of variations due to differing amounts of time spent in the six 
categories of nonapplied time, there appear to be few differences in 
pacing and grouping for individual children. 

Materials . Three types of materials were used during the observed 
sessions of WDRSD reading skills instruction, with paper and pencil 
materials (workbooks, work sheets) used slightly more than half of the 
available time during each period, between 12 and 15 minutes each day. 
Printed materials were used considerably less often and games were 
observed on only one occasion (day 5) during either period. It is 
interesting that the use of materials ranged from 0% (day 1) to 
nearly 100% (days 2, 8, 12) and that more than one type of material was 
used on only 4 of the 18 days (days 1 , 3 , 4 , 5) , all in period A 
(see Nerenz, 19791). As was the case for the pacing and grouping 
categories, there appear to be few large differences among individuals 
for those days on which only six children were observed. 

Interactions . Some form of verbal interaction was observed 
approximately 35% of the available time, for an average of about 8 
total minutes per day. During each period, the largest number of inter- 
actions were in the form of teacher to large group (i.e., directions, 
explanations, questions), although even these signs of direct teacher 
instruction occurred only about one-fourth of the available time. 
Students were observed speaking to the group during approximately 1 
minute of each lesson and were almost never observed speaking to each 
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other. In addition, one-on one interactions from observed students to 
the teacher occurred about 2% of the available time. Generally, there 
are few differences between periods or across days, and, because of the 
very small number of student-initiated interactions, differences among 
students appear to be minimal. 

Summary . Overall in school 4li2, grade 2, WDRSD reading skills 
instruction appears to occur in large groups paced by the teachers about 
three-fourths of the time each day with the remainder spent with students 
working alone in self-paced settings. Verbal interactions took place 
during only a small portion of that time and were generally initiated 
by the teacher. Paper and pencil materials were used about half of the 
time and more than one type of material was seldom used on any 
particular day. 

School 504, Grade 2 

At grade 2, nine 29-minute observations were conducted during 
period A (weeks 1 through 8) and eight during period B (weeks 11 through 
17) for a total of seventeen. As at school 452, more than six target 
children were observed during each period (10) , although unlike school 
452, only six children were observed on any particular day. Information 
on differences by period, within days, and among (:hiMr(?ri ir; roporlrrd 
in Tables 7 and 8. Content-related instruction was observed on an average 
of 13 of the 29 minutes observed each day during period A, as opposed 
to 23 of the 29 minutes per day (79%) in period B; the remaining 50% 
of the allocated time in period A was spent in nonapplied categories. 
Although this may be due in part to the manner in which observations 
were scheduled, the difference in available time should be considered 
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Table 7 

Percent of Allocated and Available Times and 
Average Daily Time from Observations for 
Means of Instruction and Interaction Variables 
(school 504, Grade 2) 



Period A (9 days) 



\ of 

al located 
tine 



\ of 

aval lablf? 
time 



Average 
dally 
time por 
studont 
(minutes) 



Period D (0 days) 



* of 

al located 
t ime 



\ of 

avui lable 
t ime 



Average 
dally 
time per 
fltudent 
(minutes) 



Total period 



1 of 

al locattid 
time 



Average 
dally 
\ of time per 

available student 
time (miriute^) 



Pac ing 



Self 
Other 

Individual 
Sna 1 1 



Paper anrl ijuncil 

Printed 

*1ani fxJlat ive 

Othi'r 



Target — ^Teacher 

Teachrr ~*-Target 

T.I rge t-**>S t uden t 

Targot or student 
— ♦nrotip 



1 

30 



30 
46 



G rouping 



2^ 
5 
46 



33 
7 
61 

t J_a^l3 

9 ^»1 

5 6 

0 0 

0 0 

1 1 

Tnceractiunii 



7 
1 

14 



1 
0 
0 

0 
0 

2 
6 



24 

38 



21 
3 



2 
0 
0 
0 

1 

0 

1 

4 



34 

b 

61 



4 
0 



7 
30 



6 
1 
11 



10 
1 



Note. Average time per class day is; 29 minutes. 
"^O* denignatfB a value less than .S. 
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Table 8 



Range and Mean of Allocated Time in Percentages for 
Means of Instruction Variables for Each Observation Day 
(School 504, Grade 2) 



to 
00 



Observation day 



Variable 



Pacing 
Self-paced 

Other-paced 

Grouping 
Individual 

Small group 

Large group 

Materials 

Paper and 
pencil 

Printed 
materials 



Period A 



Period B 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 



nuijj is the range across students. 



— Mean 

— over 
17 days 



GO 


27 


87 


37 


21 


04 


04 


20 


13 


54 


32 


26 


31 


16 


19 


38 


29 


27 


00 


13 


20 


21 


64 


12 


22 


14 


38 


26 


54 


20 


40 


36 


46 


00 


09 


26 


00 


66 


00 


52 


15 


27 


19 


55 


61 


17 


29 


57 


46 


58 


62 


55 


56 


40 


00 


04 


00 


24 


60 


68 


70 


12 


38 


12 


64 


12 


30 


36 


50 


14 


21 


30 


00 


27 


77 


39 


22 


05 


04 


18 


13 


46 


25 


26 


29 


lb 




Z J 






00 


13 


20 


21 


64 


12 


22 


14 


38 


26 


58 


20 


40 


36 


34 


12 


09 




00 


00 


10 


02 


00 


00 


00 


02 


00 


08 


11 


00 


02 


00 


03 


15 


00 


03 


00 


00 


20 


12 


00 


00 


00 


12 


00 


26 


42 


00 


12 


00 


12 


38 


00 


10 


00 


66 


00 


52 


15 


27 


24 


55 


61 


17 


29 


57 


46 


58 


62 


55 


57 


40 


00 


04 


00 


24 


60 


68 


70 


12 


38 


12 


64 


12 


30 


36 


50 


14 


21 


30 


00 


36 


87 


62 


31 


20 


28 


46 


13 


57 


21 


42 


60 


55 


21 


38 


41 


39 


00 


22 


20 


11 


74 


56 


70 


50 


38 


26 


46 


40 


34 


14 


26 


00 


21 


32 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


26 


03 


00 


00 


07 


00 


00 


02 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


66 


10 


00 


00 


42 


00 


00 


07 


each day and category, 


the upper number is the mean 


for all students observed and the lower 


t 
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when comparing percentages for period A and B. 

Pacing and grouping . Over the total observation period, and 
during periods A and B separately, students generally spent slightly 
less than two-thirds of their time in large group, other-paced activities. 
The remaining 40% of the available time was largely devoted to self- 
paced, individual work. Small group settings were observed only about 
5% of the time, for an average of approximately 1 minute per day. 

In contrast to this apparent lack of variation between periods 
there are large differences among students for individual observation 
days (Table 8) . The percentavje of allocated time spent in self-paced 
instruction ranged from less than 5% (days 1, 6, 7) to more than 80% 
(day 3). In addition, within a given day, individuals differed by as 
much as 64% (day 5) and as little as 0%, with individual children dif- 
.fering from each other by an average of 26% of the allocated time. 

Similarly, the amount of allocated time spent in other-paced 
instruction ranged from less than 20% on days 1, 3, 5, 7, and 10 to more 
than 60% on days 2, 9, and 15, while within an individual day, students 
differed by an average of 30% of the allocated time. As shown in Table 
8, there are comparable variations among days and ranges for each day 
across students for the three grouping categories. 

Materials . As at school 452, paper and pencil materials were 
used more than half of the time during each period, although they were 
observed slightly more often during period A. As was the case for the 
pacing and grouping categories, students varied by about 32% in the 
amount of allocated time using paper and pencil materials, while the 
average time per day ranged from about 20% (days 6, 11, 15) to a high 
of 87% (day 3) . Printed materials were observed only during period B 
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and then for only about 6% of the available time. On the three days 
during which printed materials were used, however, as much as 26% of 
the available time was allocated to them (day 11) / although there was 
considerable variation among students. It is interesting that more than 
a single material was used in only three of the eight observation days 
during period B and thus, for the total observation period, it appears 
that students worked with only one type of materials on 80% of the 
instructional days. 

Interactions . Interactions were observed during about 40% of the 
available time. Teacher to g.-oup interactions were most frequently 
observed, accounting for approximately 30% of the available time. 
Interactions initiated by students directed either to the group, the 
teacher, or another student were observed an average of only two 
minutes each day. 

Summary . Overall in school 504, grade 2, WDRSD reading skills 
instruction appears to occur in other-paced, large group situations about 
two-thirds of the time, with the remainder largely spent in self -paced, 
individualized work. Paper and pencil materials were generally the 
only materials used, and interactions were dominated by teacher-initiated 
speech. 

Comparison of Schools 452 and 504, Grade 2 

When comparing schools 452 and 504, several points should be 
considered. First, the amount of available time differs considerably 
by schools at grade .2, so students at one school received somewhat 
more skill instruction each day even though the time allocated to 
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reading skills was about the same across schools. Second, while stud- 
ents received reading skills instruction in large group, other-paced 
settings slightly more often at school 452 than at school 504, in both 
instances, this was the predominant mode of instruction. In addition, 
small group instruction was infrequently used at either school. 
Third, instruction at both schools was characterized by the use of 
paper and pencil materials about half of the time, and at neither school 
was a variety of materials represented either on an individual day 
or across observation days. Finally, interactions were observed about 
one-third of the time at both schools and, in each case, teacher- 
initiated speech was observed in about 75% of the instances. Thus, 
although the two schools were located in very different demographic 
and geographical settings and even though their school characteristics 
and program use scores that differ considerably, the actual variations bo 
in percentage of allocated and available time and in average number of 
minutes for four means of instruction variables are very similar for 
periods A and B and are almost identical for the total observation 
period. 

In interpreting these similarities, however, one caution should be 
considered: Although it may be tempting to think of the percentages 
for the total or for the two individual periods as being representative 
of each separate observation, yielding a picture of very routine daily 
instruction with little variation among individuals, this is not 
always the case, especially at school 504. Thus it should be remembered 
that the data provided are averages across days and may represent the 
middle point between extremes rather than the actual amount of time 
spent in each category on a day-by-day basis. 
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School 452, Grade 5 

Over the 17-week investigation period, a total of 16 40-minute 
observations were conducted—nine in period A (weeks 1 through 8) and 
seven in period B (weeks 11 through 17). As at grade 2, a large number 
of children (15) were observed, although, with the exception of days 
13 and 14 when data were obtained for five individuals, only six 
students were considered on any particular day. As shown in Table 9, 
there are no large differences by period in either the average 
number of minutes per day (29) or in the percentage of allocated time 
available for actual reading skills instruction (75%) . 

Pacing and grouping . During both period A and period B students 
spent about 40% of the available time in self-paced settings and 60% 
in other-paced instruction. As was the case at grade 2, however, there 
was considerable variation across days during each period (Table 10) ; 
the percentage of self -paced activity ranged from 10% or less (days 4, 
10, 13) to 50% or more (days 1, 2, 8, 16) and on any given day 
individuals varied in the amount of time spent in self-paced instructioi 
by an average of 19%. Similarly, the amount of time per day in other- 
paced instruction varied from 6% (day 16) to 75% (day 5) with about 17% 
difference among individuals. Although the distribution of time in the 
two pacing categories was similar during periods A and B, the grouping 
categories differ considerably across periods. 

During period A, the available time percentages for other-pacing 
are identical to those for large group work (59%) and students did 
nearly all of their self-paced activities working alone (37%) . Small 




Table 9 



Percent of Allocated emd Available Times emd 
Average Daily Time from Observations for 
Means of Instruction and Interaction Variables 
(School 452, Grade 5) 



Period A {9 days) 



* of 

dl located 
t ime 



% of 

available 
t ime 



dally 
timb per 
student 
{mi nut oh) 



Pericxl D (7 days) 



% of \ ot 

J 1 located aVd liable 
time time 



dai ly 
timti {j^r 
student 
(minutbs) 



Tutdl pericxi 



J 1 locatt'd 
t imu 



* ot 

avdi labU 



Average" 
daily 
tim«j I'er 
student 
(miriutuii ) 



S<.lf 

Otli«^r 



30 
44 



Pacing 



It>dividu:il 
Smal 1 



PjjiT arid (uTicil 
t'r intfd 

othor 



0(. 
11 
11 



10 

(J 



Interact ions; 



Ta r T » t — ♦'Tc a c h«i r 

Tf;<n:h<;r — ^.Tiirjet 

T.ir'jet'*-*-^ t uden t 

Target or student 
^r;rouj> 



0+- 

0 



Not*?. Avor-acjo time jjor class d^ay i3 -50 minutoE 
*0» rl»»'SiTn<ito<; a vdlu«} If^SB than 



Table 10 



Range and Mean of Allocated Time in Percentages for 
Means of Instruction Variables for Each Observation Day 
(School 452, Grade 5) 



Observation day 



Mean 



Period A Period B ^^^^ 

4 5 6 7 8 9 10 11 12 13 14 15 16 days 



51 58 30 10 20 17 48 50 21 07 31 45 08 35 43 66 34 

20 34 19 08 17 08 36 09 10 10 19 54 07 08 14 32 19 

19 28 50 71 75 65 15 41 66 72 10 43 73 55 46 06 46 

20 34 20 08 18 08 08 09 10 20 18 46 13 16 17 09 17 



51 35 30 08 19 17 48 50 21 07 30 00 10 35 42 66 29 

20 28 20 08 17 08 35 09 10 10 19 00 07 08 14 31 15 

00 24 00 00 02 00 00 00 00 00 02 69 73 55 01 00 14 

00 17 00 00 09 00 00 00 00 00 09 18 13 16 07 00 13 

19 27 50 71 75 63 15 41 66 73 09 19 00 00 46 06 36 

20 39 20 08 18 08 08 09 10 20 08 26 00 00 17 09 14 
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80 


40 


76 


73 


81 


51 


88 


78 


76 


39 


72 


78 


73 


64 


66 


68 


19 


u9 


30 


16 


10 


08 


35 


08 


08 


10 


26 


01 


12 


15 


00 


31 


15 


00 


00 


00 


00 


00 


00 


48 


00 


00 


00 


37 


00 


00 


00 


33 


00 


07 


Is 00 


00 


00 


00 


00 


00 


48 


00 


00 


00 


19 


00 


00 


00 


14 


00 


'05 


Within each day and category, 


the 


upper 


number 


is the 


mean 


for all 


students 


observed 


and 


the 


lower 
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groups were observed only 4% of the available time. In contrast, in 
period B, there is no clear correspondence between pacing and grouping, 
and approximately one-third of the available time was spent in each 
of the grouping categories. This difference between periods is 
illustrated more clearly in Table 10 where variations by day are 
considered. Small groups were observed on only 2 days during period 
A for 24% and 2% of the allocated time (day 2, 5). In period B, 
small group work was observed on 5 of the 1 days, for from 1% 
to 73% of the allocated time. Across all days, however, students 
differed among themselves on any given day an average of 13%. Thus, 
while the averages for the pacing variable reported for the total period 
are, to a certain extent, reflec+-.ivt of the individual perioc'o which 
they represent, this is less truM for vhe three grouping cj^tegories. 

Materials. As at grade 2,' paper and pencil materials (worksheets, 
workbooks) were most, frequently observed during each period (85% of th.i 
available time). Printed materials vere also us id during period A 
(7%) although they were only observed on a single da/ (day 7) for 48%, 
or about 19 minutes, of the allocated timo . During period B, printed 
materials and manipulatives were each observed 14'fe of the tirr.s, with 
printed materials observed on 2 days (days 11, 1^) and manipulatives 
observed on only 1 day (day 12,). Duimg both ueiiiod??, printed or 
manipulative matexi^l^ were always used in conjunction with paper and 
pencil work and darinc neither period were materials used 
regularly ovr?r a numl)er of days. 

Interactions. Ui like the grade 2 profiles described above, at 
grade 5 interactions were nearly equally divide^l between teacher- 
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initiated and student-initiated speech during period A: Teacher to 
group interactions were observed about 14% of the time; target student 
to teacher, student, or group interactions, 14%. This is less true in 
period B, when teacher-initiated speech was observed about 23% of the 
available time and student-initiated speech only about 14%. During 
both periods, some interaction was observed between 30% and 40% of the 
time . 

Summary . Due to the variations between periods in groupings, 
materials, and, to a lesser extent, interactions, a "characteristic patte 
of instruction" is more difficult to describe at grade 5 than at 
grade 2. Generally, however, it appears that students were other- 
paced in large groups about 60% of the time during period A and that 
they experienced more variety in grouping although not in pacing 
during reading skills instruction in period B. The apparent difference 
in materials between periods is deceptive, for the increase in printed 
materials and addition of manipulatives in period B occurred on only 
1 instructional day. Thus, on 12 of the 16 days of observation, 
paper and pencil materials alone were used. Finally, interactions 
were observed about one-third of the time and shifted from those 
equally representative of teachers and students in period A to more 
teacher-dominated interactions in period B. However, the amount of 
student-initiated speech appears to be the same during each portion 
of the investigative period. As at grade 2, there is consideiable 
variation across days for each means of instruction variable, while 
variations among students range from 5% (printed material) to 19% 
(self-pacing) of the allocated time. 
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School 504, Grade 5 

At school 504, eight observations of the same six target children 
were made during each part of the 17-week investigation period. Unlike 
observations at school 452, however, the entire reading period was 
observed rather than simply the reading skills sessions, resulting in 
observations averaging 83 minutes each. Contrary to what might be 
expected, the percentages of allocated time reported in Table 11 are 
not much different from those at school 452 (Table 9) , despite the 
fact that the extended data collection period included more diverse 
kinds of academic and nonacademic activities. 

Pacing and grouping . Overall, students were largely self-paced 
during the total period (88%) , with nearly all of their time (93%) 
spent in such settings during period B. On individual observation 
days during both periods, however, the percentage of time spent in 
self-pacr^d instruction ranged from approximately 43% to 87% and 
individuals differed from one another by 41% of the allocated time 
(Table 12). The amount of other-paced instruction decreased from 18% 
to 7% from period A to period B, although there was still considerable 
variation among students across days: Differences among students aver- 
aged 24% of the allocated time and ranged from less than 10% on 4 
days (days 2, 6, 11, 12) to more than 50% on days 7 and 8, both in 
period A. Thus, although the similarity between the figures provided 
for each observation period leads one to believe that there was 
considerable regularity in the means of instruction used during reading 
sessions, this is not entirely the case when individual days and 
chil'li !i are considered. 
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Table 11 

Percent of Allocated and Available Times and 
Average Daily Time from Observations for 
Means of Instruction and Interaction Variables 
(School 504, Grade 5) 



r t mv' 



time 



AviT jrjij 
Limo I '(J I 
(ml nutim) 



t tm.- 



JVd i 1 111 
t i mf 



Av(_r.i ji-' 
iljl ly 
t imii | (;r 



Av»T aji- 
(mi tiu(.i>Li ) 



r.f 1 f 



47 
10 



1) 
1 1 



1 ) 



7U 
-1 



•19 



IT info. J 
M'ln [pul It t V 



T ir-|oL— *T««j'-h»'r 
T" .T — »Tcirg..>t 

T.ir'}»'f or .'iLuih'M 
1^ 'I roup 

T' • f.-h' .T r, r ( > u I > 



Not*-, Av«ir.ir|*> ttin« por i-ljss 'Uy is H3 minutes. 



63 



Tall 1.0 .1.:^ 



Hany.) and Moan of Mlucatud 'I'liiiu in Porcimtayofi for 
Moanu of Inatriictioii Variables foi: t!at;h ObyervaLion Day 
(School 504, Grade 5) 



Obijorvation day 

„ ^ . ■ .. . ■ ■ Mean 

Period A Penod B 



Variable 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


U 


12 


13 


14 


15 


16 


days 


Pacing 




































Self-paced 


43 


59 


50 


53 


83 


87 


75 


64 


49 


79 


73 


61 


79 


80 


70 


83 


68 


57 


50 


33 


30 


19 


20 


66 


51 


64 


40 


24 


56 


30 


27 


57 


38 


41 


Other-paced 


31 


16 


08 


23 


05 


02 


12 


18 


14 


02 


09 


00 


00 


00 


07 


06 


10 


35 


09 


48 


20 


23 


10 


62 


56 


17 


14 


06 


04 


00 


00 


44 


33 


24 


Grouping 




































Individual 


47 


47 


44 


47 


74 


69 


72 


60 


38 


72 


60 


44 


63 


70 


83 


73 


60 




57 


41 


38 


50 


43 


51 


56 


56 


30 


40 


37 


48 


17 


27 


61 


42 


44 


Small group 


1 c 

lb 


1 A 
14 


1 1 


1 1 


14 


iv 






11 


09 


15 


18 


16 


10 


17 


16 


15 


10 


J I 


J J 


40 


47 


41 


62 


62 


34 


24 


35 


40 


17 


25 


48 


41 


39 


Large group 


29 


14 


00 


18 


00 


00 


00 


08 


14 


00 


07 


00 


00 


00 


00 


00 


05 


44 


18 


00 


20 


00 


00 


00 


17 


17 


00 


08 


00 


00 


00 


00 


00 


08 


Materials 




































Paper and 


50 


50 


51 


63 


76 


76 


82 


73 


55 


38 


59 


37 


45 


40 


50 


33 


55 


pencil 


40 


80 


80 


61 


23 


37 


09 


31 


47 


83 


54 


51 


17 


68 


25 


71 


48 


Printed 


56 


43 


13 


26 


30 


35 


16 


07 


13 


56 


35 


46 


50 


54 


44 


68 


37 


materials 


53 


48 


42 


65 


75 


86 


62 


36 


33 


55 


60 


29 


47 


31 


43 


41 


50 







































Note . Within each day and category, the upper number is the mean for all students observed and the lower number 
is the range across students. 
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The increase of 11% in the amount of available time spent in «oll:- 
pacxid activities during period B is reflected, in part, in the three 
grouping categories, where the amount of time spent in individualized 
settings increased from 70% to 78% from periods A to B with a corres- 
ponding decrease in large group work. Over the two periods, however, 
^ small group instruction occurred during about 19% of the available time, 

and as shown in Table 12, was rather equally distributed over the 16 
observation days. Even with this more regular distribution of time, 
students still differed from each other by an average of 39% per day. 

Materials . Some form of materials was used about 119% (more than 
one material could be coded for a total of up to 500% during periods 
A and B) and both paper and pencil and printed materials were observed 
on each of the 16 observation days. While paper and pencil materials 
were more frequently used (81%) than printed materials (37%) in 
period A, both were used about 60% of the time during period B. The 
use of paper and pencil materials varied considerably by day (from 
33% of the allocated time on day 16 to 82% on day 7) as did the use of 
printed materials (7% on day 8 to 68% on day 16) . In addition, it is 
interesting that children differed from each other by an average of 
50% per day and that, overall, both materials were used on a day-to- 
day basis. 

Interactions . There are two interesting aspects of the inter- 
actions data at school 504. First, in contrast to information obtained 
at other schools and grades, interactions were observed loss than 
20% of the available time, or about 10 of every 60 minutes during the 
total observation period, compared with over 32% at school 452, grade 2, 
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31% at achcx-)! 4':i2, c|radu ') , I'J'*^ cil: luMnol SOl , qraclo 2. In .uUlltitJiw 

dur inq vt^r ^LK\ only 7 mluuUi^M of inbtr.ua: lonM wo.n) o(uUul, or LV^ 
oe the availabio l:luu>. Soconcl, the inturac tionu wnro not pre(.lomlnant..l-y 
teachor-initiatod. Rathor, toachera Initlatud 4 minutou and 2 mi.nuton 
of speech during periods A and B, while Btudonts initiatud 6 and i) 
minutes of interactions, respectively. However, oven in what appoarii 
to be a highly individualized instructional setting no one-on-ono 
interactions from teachers to target students were observed during oither 
period. 

Summary . At school 504 for grade 5, instruction almost always 
occurred in self-paced, individualized settings, with considerable use 
of small groups and pairs and an average of less than 4 minutes per 
day in large group instruction. Only paper and pencil and printed 
materials were observed, although they were each used on all of the 
observation days. Whit there generally were more student-initiated 

than teacher-to-group interactions, any form of interaction was 

infrequently observed. 

Comparison of Schools 452 and 504, Grade 5 

Overall, the pattern of grade 5 reading instruction appears to be 
quite different at the two schools. While students were self-paced 
approximately 43% of the time at school 452, self-paced settings were 
observed an average of 88% during the total period and as much as 
93% during period B at school 504. Similarly, large group instruction 
wa.s more frequently observed (46%) over the total period at school 452, 
although it must be remembered that these totals reflect very different 
usage during oacli period? at school 504, large group instruction 
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<nMJo\int.tul tui only 7'* ol: t.lit) aViUliUUti turn wilh un.uly Ihi «iti-t:iMn I 
ui I lin iufil-nuM iuual jun Uul ill liullvul\ial work ami :AVi in iiiiuU I 

t|ro\i|ni, AltluHuiU both jiuhoobi rulitui huav/i ly c^n ivn^iir niul |U3nt.M I 
maLin'Laln, at: Hchooi. thoju) wrico \uitul almotit t)xa.LuH;l.vt) Ly on a (Liy- 

to-day basiiJ. At: achooi r)04, papur and lioncLl maturlalu wuru alwayii 
muid in conjunction with printed matorial. Finally, there woro conai- 
durably fewer total interactions at achool 504, and ytudenta initiated 
more of them than did teachers; at school 452, students initiated fewer 
interactions than did teachers but in absolute numbers had more oppor- 
tunities to speak. There are indications of considerable variation eimong 
individuals across days at each school and the difference in grouping 
strategies between periods A and B at school 452 are striking. However, 
students varied among themselves much less for the pacing, grouping, 
and materials categories at school 452 than at school 504. Thus, as 
at grade 2, the obtained percentages for periods A and B and for the 
total period may be deceptive in that they do not represent this 
larger amount of difference between the two schools. As noted pre- 
viously, observations at school 504 were conducted during the entire 
reading period while those at school 452 reflect only the period of 
time allocated to skills instruction and may be less representative 
of the overall instructional pattern of reading instruction. 
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V 

TIME PROFILES 

Information on classroom time was obtained from two sources. The 
first r the teacher logs, provided an estimate of the amount of time 
which teachers allocated to reading skills instruction, and more 
specifically to Word Attack, Study Skills, and Comprehension objectives. 
The logs were maintained over 2 7-week periods for a sample of six 
randomly selected target students; a discussion of the logging procedure 
as well as a summary of the log data are available in Project Papers 
79-21 and 79-31 (Nerenz, 1979a; Webb, 1979b). The second source of 
information about classroom time was the time sampling observations. As 
outlined in the previous chapter, 16 to 18 observations were conducted 
during the 17-week investigation period. Information was obtained on the 
several types of time — nonapplied time, available time, engaged time, 
and nonengaged time — which are defined at the beginning of section IV 
and detailed descriptions of the observation procedures, definitions, and 
unaggregated data are provided in Project Papers 79-16, 79-19, 80-1 and 
79-32 (Nerenz, 19791, 1979j ; Nerenz & Webb, 1980; Webb, 1979a). 

In this section of the report, time profiles are developed using 
information from the teacher logs and the observations. The distribution 
of time across and within days is first considered, incl •ing profiles 
of the number of instructional days over the two observation periods 
and the percentage of allocated, available, and average daily time. In 
addition, tnis total amount of time is reported for each of 12 general 
objectives to which it might have been allocated so that the interaction' 
between time ♦ nd reading skills content might be considered. 
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Grade 2 

Distribution of Instructional Days 

At both schools, the teacher logs were maintained for 14 weeks, a 
total of 70 instructional days. As shown in Table 13, the number of 
days which were available for reading skills instruction was then par- 
titioned in order to determine the amount of time during which instruction 
was actually provided. At school 452, skills sessions were not scheduled 
on an average of 4 days during each period. In addition, target 
students were logged as absent an average of 5 days, so instruction was 
recorded as being provided on 57 of the 70 possible days, or 81% of the 
time. The total amount of instructional time is similar at school 504, 
where skill sessions were logged on 55 days, or 78% of the time. Absentee- 
ism accounts for very few of the noninstructional days in either period? 
rather, reading skills instruction was not scheduled for 13 days, or 
almost 3 full weeks. 

Allocated, Available, and Average Daily Time 

More detailed information on the distribution of instructional 
time was collected using ci «'oom observations and is reported for 
periods A and B and for the ;al period in Tables 14 and 15. 

School 452 . While teachers logged a total of 5 days on which 
students were absent (Table 13) , observers found that students were 
absent over twice as much of the time during period A (13%) as period B 
(5%) and that they averaged 9% absenteeism, the equivalent of 6 logged 
days (Table 14) . This discrepancy between the two data sources may be 
due in part to observer errors or to the fact that teachers generally 
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Table 13 

Average Distribution of Instructional Days 
-for Periods A and B and for the Total Period 
(Schools 452 and 504, Grade 2) 



School 452 



School 504 



Period 



Period 



B Total 



B Total 



Total number of days 
available for reading 
skills instruction 



35 35 70 



35 35 70 



Average nimber of days 
during which reading 
skills instruction was 
not scheduled 



13 



Average nimber of 
days absent 



Average nimber of days 
during which reading 
skills instruction 
was provided 



28 29 57 



25 30 55 
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Percent of Allocated and Available Times and 
Average Daily Time from Observations for 
Means of Instruction and Interaction Variables 
(School 452, Grade 2) 



Variable 



Period A 



% of % of 

allocated available 
time time 



Average 
daily 
time for 

student 
(minutes) 



Period B 



% of 
al located 
time 



% of 
aval lable 
time 



Average 
dai ly 
time for 

student 
(minutes) 



Total Period 



% of 

allocated 
time 



% of 
avdi labl G 
time 



Average 
daily 
time for 

student 
(minutes) 



Absent 



13 



Nonappl ied t imo 



26 



10 



34 



14 



30 



12 



Available time 



62 



100 



61 



26 



62 



25 



:'ngaged time 



41 



67 



16 



12 



6B 



18 



42 



69 



17 



Nonengaged time 



20 



33 



20 



20 



32 



Total time for 
reading skills 
period 



42 



41 



72 



57 



did not complete the logs on a day-by-day basis and thus the data provide 
only an estimate of the distribution of instructional time. 

The next four categories provide estimates of the way in which 
time was used each day; there is little variation in these estimates 
across periods. As shown, 12 minutes, or about 30% of the observed 
time was spent in one of the six nonapplied categories. This resulted 
in approximately 25 minutes or 62% of the observed time being available 
for actual content instruction. Of this available time, students 
spent 17 minutes (68%) actively engaged in reading skills instruction 
and about 8 minutes (32%) in nonengaged activities. Thus, of the 41 
minutes scheduled for reading skills each day, less than half were 
spent with students actually attending to the assigned material. 

School 504 . At school 504 (Table 15) observations showed that 
students were absent an average of 7% of the available time, the 
equivalent of 5 total days, compared with an average of 2 days indicated 
on the teacher logs. On the days during which instruction was provided, 
students spent an average of about one-third of the allocated time 
during the total period and as much as 40% during period A in nonapplied 
activities. Of the remaining available time, nearly 80% was spent in 
engaged activities during period A, or about 11 minutes per day. In 
contrast, while the percentage is lower during period B (62%), a slightly 
greater number of minutes (14) was actually spent actively on content. 
Overall, the total engaged rate of 12/29 minutes or 43% is almost identical 
to that at school 452 (12/41 or 42%) for grade 2 reading skills instruction. 
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Tab\c 15 



Percent of Allocated and Available Times for 
Average Daily Time from Gbservaticas fcr 
Means of Instruction and Interaction Variables 
(School 504, Grade 2) 



Period B 



Total Period 



Var iabUi 



% of % of 

allocated available 
time time 



Average 
dai ly 
time per 

student 
(minutes) 



% of % of 

allocated ava i lable 
t i me t i me 



Average 
daily 
time per 

student 
(minutes) 



% of % of 

allocated available 
time time 



Average 
daily 
time per 

student 
(minutes) 



Absent 



10 



NonaFJplied time 



12 



20 



31 



Avai lable timn 



49 



100 



14 



76 



100 



62 



18 



Engaged time 



40 



80 



11 



47 



62 



43 



70 



12 



Nonengaged time 



10 



20 



29 



38 



19 



30 



Total time for 
reading skills 
period 



28 



30 



29 
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Time Profile by General Objective 

Since data could have been obtained for over 80 objectives at grade 
2, individual WDRSD skills were aggregated by WDRSD element and strand 
resulting in 31 specific objectives, 12 general objectives and three 
content areas, as illustrated in Figures 2 to 4 . For each of the 
general objectives, information on log allocated time, observed time, 
engagement, and estimated total minutes is provided separately for the 
two schools. 

School 452 . At school 452 (Table 16) , some time was allocated to 
all but two of the general objectives during period A and all but one 
of the objectives during period B. As would be expected at grade 2, 
the largest block of time, about 1,000 minutes, was allocated to Word 
Attack skills (01-05) , with most time overall being spent on Vocabulary 
Meaning (05) and Structural Analyses (04) skills. Although considerable 
time was allocated to both skills, emphasis was placed on Vocabulary 
Meaning (05) during period A, while somewhat more time was allocated 
to Structural Analysis (04) during period B. The small amount of time 
allocated to Phonic Analysis overall may be due to the fact that data 
were collected during the second half of the school year and students 
may have already mastered most of these B- and C-level skills. This may 
be especially true for Phonic Analysis — Consonants (01) where considerably 
more time was allocated during period A than during period B. 

Over twice as much time was allocated to Comprehension (06-09) ; 850 
minutGs) as to Study Skills (10-12; 340 minutes) over the total pe>ri(»d. 
Passage and Sentence Meaning skills (06, 07) were allocated about the 
same amount of time in both periods, while all of the General Reading 
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Table 16 



Time Allocation from Logs and Observations on General Objectives 
For One Student By Period 
(School 452, Grade 2) 



Period A 



Period B 



Lot) Number of 
allocatGcl minutes 



General objectives 



Estimate Estimate Log Number of 

engaged of total % engaged allocated ninutcs 

time observed of ob- engaged of ob- time observed of ob- 

(minutes) of 233 served time served (minutes) of 210 served 

minutes avail- (minutes! allocated minutes 
time 



01 Phonic Analysis- 

Consonants 80 54 

02 Phonic Analysis- 
Vowels 60 34 

03 Phonic Analysis- 
Silent Letters 40 00 

04 Structural 

Analysis 150 00 

05 Vocabulary 

Meaning 250 h\ 

06 Passage Meaning 

Skills 150 42 

07 Sentence ^leaning 

Skills 100 18 

OB Word Meaning Skills BO 00 

09 General Reading 

Time 00 00 

10 Hap Skills 50 00 

11 Graph and Table 

Skills 60 24 

12 Reference Skills 00 00 



avail- 
able 
time 



% Estimate Estimate 
engaged of total \ engaged 
engaged of ob- 
time served 
(minutes) allocated 
time 



avail- 
able 
time 



Total period 

Allocated EstimiHe 
time of total 
logged engaged 
(minutes) time 

(minutes) 



54 25 31 



69 24 



73 69 



76 28 



40 



10 



70 



67 102 41 



46 



76 44 44 



30 00 



280 74 70 123 44 



120 47 68 4IJ 40 

180 52 62 69 38 



90 00 

10 00 

240 00 

leo 23 



47 



50 



:2 4 



90 
130 

70 

430 

370 

330 

190 
90 

240 
230 

110 
00 



150 
13B 



50 



76 



61 



time (09) was observed during period B. More time was also logged for 
Study Skills during period B, although no time was recorded as being 
spent on Reference Skills (12) during either period. 

During periods A and B, instruction was observed for about half of 
the 12 general objective areas. For the most part, areas which were 
not observed were allocated less than 100 minutes in either period 
(period A— 03, 08, 09, 10, 12; period B~01, 02, 03, 07, 08, 12). 
However, considerable time was allocated to Skill 04 during period A 
and Skill 09 during period B, none of which was observed. While it could 
be possible that instruction occurred during week 14 when no observation 
was made, the teacher logs show that such is not the case; thus, in- 
struction was logged for the equivalent of 10 41-minute sessions on 
these two skills for which no observational data were collected. 

Engagement varied only slightly by content area, especially during 
period B, and it is clear that students actually were engaged during less 
than half of the allocated time. Thus, of the 280 minutes allocated to 
Structural Analysis (04) for period B, only an estimated 123 minutes, 
or 44%, were actually spent by students actively attending to the 
materials . 

School 504 . At school 504 (Table 17) , some time was logged for all 
but one of the skills during each period and approximately two-thirds 
of the time during both periods was allocated to Word Attack Skills 
(01-05) . During period A, Phonic Analysis — Vowels (02) and Silent Letters 
(03) were emphasized, while considerable time was spent on Phonic Analysis 
Vowels and Structural Analysis (04) during period B. About 230 minutes 
were allocated to Comprehend: ion Skills (06-09) during each period. 
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Table 17 



Time Allocation from Logs and Observations on General Objectives 
For One Student By Period 
(School 504, Grade 2) 









Period A 










Period B 






Total period 




Log 


Nunber of 


\ 


Estimate 


Estimate 


Log 


Number of 


\ 


Estimate 


Estimate 


Allocated 


Estimate 




allocated 


minutes 


engaged 


of total 


\ engaged 


allocated 


minutes 


engaged 


of total 


* engaged 


time • 


of total 




time 


observed 


of ob- 


engaged 


of ob- 


time 


observed 


of ob- 


engaged 


of ob' 


logged 


enaaaed 




(mi niihpc) 




served 


time 


served 


(minutes) 


of 180 


served 


time 


served 


(minutes) 


time 






minutes 


avail- 


(minutes) 


allocated 




minutes 


avail- 


(minutes] 


a] lncat(5d 




(minutes) 


wucial UDjeCCiVfiS 






able 




time 






able 




time 










time 










time 








01 Phonic Analysis-- 


























Consonants 


83 


23 


73 


30 


36 


6 


00 


- 


- 


- 


89 




02 Phonic Analysis- 


























Vowels 


159 


33 


B8 


69 


43 


194 


46 


53 


78 


40 


353 


14? 


03 Phonic Analysis- 


























Silent Lp^^^^r<^ 


iuj 


Irk 


U 


37 


36 


10 


00 








113 




04 Structural 


























Analysis 


66 


18 


83 


27 


41 


358 


113 


66 


179 


50 


424 


206 


05 Vocabulary 


























Meaning 


30 


11 


88 


13 


43 


45 


14 


64 


22 


49 


75 


35 


06 Passage Meaning 


























Skills 


31 


00 








4 


00 








35 




07 Sentence Meaning 


























Skills 


U 


00 








9 


00 








23 




08 Word Meaning Skills 


13 


00 








5 


00 








18 




09 General Reading 


























Time 


181 


00 








201 


7 




76 


39 


382 




10 Map Skills 


10 


00 








2 


00 








12 




11 Graph and Table 


























Skills 


00 


00 








00 


00 








00 




12 Reference Skills 


6 


oo 








44 


00 








50 
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However, nearly all of this was spent in General Reading (09) rather 
than on specific passage, sentence, or word meaning skills. Very little 
time was allocated to Study Skills. 

With only one exception (Objective 09 - period B) , all of the 
observations were conducted during Word Attack instruction. During 
period A, all five Word Attack objectives were observed, while during 
period B observations were conducted during instruction in three of the 
five areas. Generally, content areas which were not observed were 
allocated very small amounts of time or were scheduled during the reading 
block rather than the skills period, as was the case with Objective 09. 

Within each period, it appears that engagement does not vary much 
by content taught. Overall, students were engaged about 42% during 
each period, indicating that for every 29-minute instructional session, 
students spent only about 12 minutes actively working with the particular 
reading skills. 

Comparison of Schools 452 and 504, Grade 2 

The use of time during grade 2 reading skills instruction appears 
to be very similar at the two schools. Although teachers logged more 
days without skills instruction at school 452, each school provided 
instruction on about 80% of the possible instructional days. Absenteeism 
differed by only 2% (school 452 — 9%; school 504 — 7%) . Over all of the 
ob<5ervation days, students spent 30% and 31% of the time in nonapplied 
activities and 62% was actually available for instruction. Of this, 
engagement averaged 68% at school 452, and 70% at school 504. Most of 
the observed and allocated time was devoted to Word Attack skills. 
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Although engagement appeared to differ only slightly by content at 
each school, it is interesting that somewhat different content was 
taught, with considerable time allocated to Vocabulary Meaning (05) at 
one school and to Phonic Analysis — Vowels (02) at the other. Structural 
Analysis skills (04) were taught at both schools for almost the same 
amount of time, 430 minutes at school 452, 424 minutes at school 504. 

Grade 5 

Distribution of Instructional Days 

As at grade 2, logs were maintained for 14 weeks for a total of 
70 possible instructional days, as shown in Table 18. At school 452, 
no reading skills instruction was logged on 17 of these days and an 
average of only one absent day was recorded. This resulted in a total 
of 52 instructional days or 74%. In contrast, at school 504 skills 
instruction was not scheduled on 4 days and children were logged as 
being absent an average of 2 days such that instruction was logged on 
64 days, or 91% of the total time. 

Allocated, Available, and Average Daily Time 

More detailed information on the distribution of time within an 
average instructional day was obtained using classroom observations. 
This information is reported for both periods and for the total period 
separately for the two schools. 

School 452 . While both the logs and observations are in agreement 
about the number of days during which students were absent in period B 
(0) , as at grade 2 there is some disagreement about the amount of 
absenteeism during period A: The observations report about 9% of the 
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Table 18 

Average Distribution of Instructional Days 
for Periods A and B and for the Total Perioi 
(Schools 452 and 504, Grade 5) 



School 452 School 504 



Period Period 



A B Total A B Total 



Total number of days 

available for receding 35 35 70 

skills instruction 



Average number of 
days during which 
reading skills instruction 
was not scheduled 

Average nuiuber of 
days absent 



7 10 17 2 2 4 



1 00 1 11 2 



Average number of days 

during which reading 27 25 

skills instruction was 

provided 
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allocated time, the equivalent of 3 logged days, compared with 1 
actually logged (Table 19). Nonapp.lied time averaged 19%, or 8 mir 
per day. Of the 30 minutes of available time, 22, or 76%, were spei. 
with students engaged and 7, or 24%, were '^rved in nonengaged 
activities. Thus, of the 40-minute rec iod, students spent an 

average of 57%, or 22 minutes, actively lec^rning reading skills. 

School 504 . At school 504 (Table 20), students were absent an 
average of 5% of the allocated time, or 4 logged days, identical to 
the number recorder'' on the logs for the total period and for periods A 
and B. As at school 452, about ?2^ of the allocated T:.ime was spent in 
nonapplled categories. As at school 452, students were actively engaged 
in learning th^- reading skills content slightly more than three-fourths 
of the: remaining 61 minutes of available time, or about 56% of the 
allocated time. These porcentages are only about 10% higher than those 
observed at grade 2. The grade 5 percentages are similar across schools 
in spite of the facts that the curriculum program was implemented quite 
difff^rently at the two schools and that different amounts of instruction 
were observed. 



Table 19 



Percent of Allocated and Available Times and 
Average Daily Time from Observations for 
Instructional Time Variables 
(School 452, Grade 5) 



Variable 



Period A 



% of of 
aMocatftd available 
time time 



Average 
daily 
time per 

student 
(minutes) 



* of % of 

allocated aval lable 
time time 



Average 
daily 
time per 

student 
(minutes) 



Total period 



% of 



\ of 



Average 
daily 



allocated available time per 
time tirve stv. .«nt 

(minuvcjs) 



^sent 



lonapplied time 



17 



23 



19 



iVa liable time 



74 



77 



100 



75 



100 



Ingaged time 



55 



73 



23 



57 



76 



22 



on engaged time 



20 



27 



16 



18 



otal timo for 
reading skills 
period 



100 



40 



100 



38 



100 



40 
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Table 20 



Absent 



Percent of Allocated and Available Times and 
Average Daily Time from Observations for 
Instructional Time Variables 
(School 504, Grade 5) 



Variable 



Period A 



% of % of 

allocated available 
time time 



Average 
dai ly 
time per 

student 
(minutes) 



Period B 



Average 

% of * of daily 

allocated available time per 
time time student 

(minutes) 



Total period 



Average 

% of % of daily 

allocated available time per 
time time student 

(minutes) 



Nonapplied time 
Available time 



20 



100 



16 



58 



23 



78 



100 



20 



64 



22 



73 



100 



18 



51 



Engaged time 



52 



72 



59 



81 



51 



56 



76 



46 



Monengaged time 



28 



16 



14 



19 



12 



17 



24 



14 



rotal time for 
reading skills 
period 



87 




ERIC 



Table 21 



Time Allocation from Logs and Observations on General Objectives 
For One Student By Period 
(School 452, Grade 5) 



>jeneral Objectives 



Peru^ A 



Period B 



Log Nunber of 
allocated minutes 
tine obsorved 
(minutes) of 2()6 
minutes 



\ Estiinate 
engiigod of total 



01 ?honic Analysis- 
Consonants 00 

02 Pl'ionic AnalysiS" 
Vow;il5 30 

03 Phonic Anfllysis" 
S:lent LHtc^a 00 

04 Structaal 

Analyyj.] 30 

Meaning 00 

06 Passagf^ Heaning 

ftills 350 

rk'ills 00 

0' WOi.^ Hcanirg Skills 130 

09 .eneral Reading 

Tiitifi 70 

.0 Map Skills ?4n 

J] Uaph iind Tabk 
S'dlls 

12 Hmivy. CiUr uO 



of ob- 
serve 
avail- 
able 
time 



engaged 
time 



Estimate 
\ engaged 
o£ ob- 
served 



Log 



rof 



(minutes) allocate^l 
time 



allocated mnutes engagd 
tine observed of ob- 
(minuiM,) of 204 served 
minutes avail- 
able 
time 



Estimate 
of total 
engaged 
time 



Estimate 
\ engaged 
of ob- 
served 



00 - - ' 

00 • - - 

00 - - . 

00 • - - 

00 - • ' 

150 n 196 56 

00 • - - 

29 /O 69 53 



00 - ' - 

^fl 122 51 

31 Bl 1^4 60 

OD • - 



00 00 



00 00 



130 40 



130 00 
250 35 



(minutes! allocated 
time 



_ Total period . 

Allocated Estimate 
time of total 
logged engaged 
(ininutes) tiine 

(ninutes) 



30 
00 
30 



83 64 



279 



90 57 62 47 ^2 
110 i:0 



167 67 



270 M 90 m 



90 



200 



240 
:|70 



209 



70 



Meaning; 08, Word Meaning; 10, Map Skills. Because instruction in 
Word Attack skills (01-05) is generally completed by fifth grade, it is 
not surprising that it was allocated very little time. An almost equal 
emphasis on Study Skills and Comprehension is reflected in the fact that 
about the same nvimber of minutes was spent on instruction in Comprehen- 
sion (06-09) as in Study Skills (10-12) over the total period. The time 
is distributed somewhat more evenly among the skills during period B and 
all of the instruction in Graph and Table skills (11) was allocated 
during period A v/hile Reference skills (12) were studied only during 
the last 8 weeks. 

As indicated \a t>.^ s ond column of figures for both periods, 
instruction was a'V-v'c Ij.y .i-^served Jfor four skills during each period. 
Although observe; / i* " . .,v".re generally conducted on a weekly basis, no 
: : .a Ajre obtained for week 14; this may account for the large amount 

L^r. J u.'llo.^ated to objectives 08 and 09 for which instruction was not 
oL^or.ved during period B. During period A the three objectives with time 
allocated but not observed had relatively little time allocated. 

The engaged percent of observed available time and the estimated 
engacod per,;ent of observed allocated time show the amount of engaged 
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skills (06) during period A, students were observed actively learnipg 
the material only 56% of the time (196 minutes) . During period A, it 
is clear that slightly more than half of the time set aside by teachers 
for instruction in any particular skill was actually spent in those 
pursuits. While estimates are not available for two skills and 
appear to be higher for three of the other four during period B, the 
average percent of allocated time is still only 61% (Table 19) . 

The log allocated time and estimated engaged time for the toc^i 
period, given in the last two columns of the table, indicate that 
overall at school 452, the most time was devoted to Passage Meaning 
(06) and Map skills (10) with half as much time spent in each of the 
four other areas (08, Word Meaning; 09, General Reading; 11, Graph and 
Table skill^^j and 12, Reference skills) and very little time in the 
six remaiiixvg objectives. In addition, they provide summaries of the 
difference citween allocated time and active learning time over the 
17-week investigation period. 

School 504. At sC-o.-)! i)04 (Table 22), some time was logged for 
10 of the 12 content areai (Tabl-^ 21), although, as at school 452, very 
little time was allocated to Word Attack skills (01-05) . In addition, 



Table 22 



si 



Time Allocation from Logs and Observations on General Objectives 
For One Student By Period 
(School 504, Grade 5) 



Period A 



Period B 





Log 


Nuinber of 


\ 


Estimate 


Estiwte 


Log 


Numbur or \ 


Estimate 


LstiiUdte 


Ailocatod 


- ■" " 
Estimate 




allocated 


minutt's 


engaged 


of total 


\ entijcied 


allofi'ited 


minutes pntiLiiicd 


of total 


\ engaged 


time 


of total 




time 


observed 


of ob- 


engaged 


of ob- 


time 


observed of ob- 


oiiyaged 


of ob- 


logged 


engaged 




(nini)to^>l 


o: 


served 


time 


served 


(minutesl 


of 508 served 


lime 


served 


(minutesl 


tia' 






fniniji"s 


avail- 


(minutes) 


allocated 




initiutGS avail- 


(minutes) 


allocated 




(miiiutGs) 








able 




time 




able 




tlBlC 






General Objectives 






time 








time 










01 Phonic Analysis- 













— 














Art 


00 








Oil 


00 






00 




























Vowels 


10 


7 




i; 
J 




on 


nn 






iV 




I' J vwr . flMruysiS"" 
























Silent Letters 


00 


on 








00 


00 






00 




04 Structural 
























Analysis 


10 




73 


7 


70 


DO 


00 






10 




05 Vocabulary 
























Jlcaninq 


80 




% 


5B 


72 


10 


3 50 


4 


40 


90 


62 


06 Passage Meaninq 
























Skills 


]00 


61 


74 


163 


54 


240 


31 90 


155 


64 


540 


ilH 


07 Sentencfj Moaning 
























Skills 


v.] 




Bl 


40 


57 


20 


00 






90 




08 Word Meaning Skills 


160 


53 


77 


92 


5a 


160 


IG 80 


97 


61 


320 


ltj9 


09 General Reading 
























Time 


loeo 




65 


514 


'10 




■IjO ho 


901 


58 


2G20 


1415 


10 Hap Skills 


60 


76 


7f 


35 


50 


'D 


2 100 


12 


GO 


80 


47 


11 Graph and Table 
























Skills 


20 




35 


6 


30 


30 


0 85 


IG 


53 


50 


21 


12 Reference Skilln 




87 


7B 


2[/; 


57 


190 


28 82 


115 




G40 


rn 
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across periods, with Passage Meaning (06), Word Meaning (08), and 
Reference skills (12) receiving the most allocated time. 

Even more than at school 452, time was observed in the content 
categories for which log information was recorded and observations 
sampled at least 15% of the time allocated to each objective during 
each period. This is interesting in that observations were not con- 
ducted during weeks 6 and 12 and thus there exist more periods of 
instruction which are not represented in the observational data at this 
school than at school 452. 

The engaged of observed available percentage time generally ranged 
from mid-70s to low-80s for period A, and 80 or above during period B. 
It is possible that in several instances, Vc-.riations are due to the small 
amount of time observed (Objectives 5 and 11, period A - 7 minutes; 
Objective 5, period B - 3 minutes; Objective 10, period B - 2 minutes). 
As at school 452, it appears that students ar€^ engaged during slightly 
more than half of the allocated time, with percentages ranging from 30% 
to 72% during period A and 40% to 64% during period B. Thus, of the 
300 minutes allocated to Passage Meaning (06) in period A, sLudents were 
engaged for 162 minutes, the equivalent of four 40-minute sessions, and 
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absent 5% of the time at oach school; about 20% of the ailoceitc^d time 
was spent in nonapplied categuritjs, available t i... iveroM^d about 7S'i, 
and students were engaged 76^ M luo avaixabie time at each school or 
about 57% of the allocated time. Instruction was obs^erved in nearly 
all of thr: content areas and li.ttle Word Attack Lime was scheduled at 
eLther school. 

However, the schools also differed on several points. At school 
452, only 74% of the possible number of instructional days were actually 
used for skills instruction, compared with 91% at school 504, the 
difference being due to the fact that teachers did not schedule 
instruction on 17 days during the investigation period. In addition, 
skills instruction at school 452 focused almost equally on Study Skills 
anc: Comprehension, while at school 504, Comprehension was allocated over 
four times as much. This difference is due largely to the fact that 
all readin ) Instruction was observed at school 504 where General Reading 
was logged 2,620 r 
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ACHIEVEMENT PROFILES 

Achievement profiles were developed from two types of measures, 
each administered on three occasions (weeks 1, 9, 18) . The achieve- 
ment monitoring procedure provided a means of assessing achievement 
for a group of students — in this case, the class or the unit. Be- 
cause the set of two to four items testing each skill was divided among 
four test forms and one-fourth of the students completed each form at 
a given administration, detailed achievement data were obtained for 
a large number of skills with a minimal amount of ti;ne spent in test- 
ing. However, because this matrix-sampling procedure was used in 
developing the tests, information was not obtained about individual 
students' achievement. At grade 2, 30 objectives w^^^re tested: 19 Word 
Attack, 5 Comprehension, and 6 Study Skills. At grade 5, 26 objectives 
were tested: 3 Word Attack, 6 Comprehension, and 17 Study Skills. 

In addition to the achievement monitoring tests, a domain ref- 
erenced testir*;; procedure was used to obtain information on each 
studenv- for a much smaller number of reading skills (Harris & Pearlman, 
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Nerenz, and Webb (1979) and by Nerenz (1979b, 1979c, 1979d, 1979e, 
1979f , 1979g) . 

The achievement profiles discussed below provide several kinds 
of information. Students' growth over the three administrations of 
the achievement monitoring tests as well as t lO ov^-t.all gain from test 
time 1 to test time 3 are included for tb*^ 'al objectives which 

were tested at each grade level. In intn* g these results, it is 

important to remember that each form of w^v^hi ovement monitoring 

tests was administered to one-fourth of the qroup at any one testing 
and thus the percentage correct for each objective is generally based 
on scores from only one-half to three -fourths of the listed number of 
students. 

Although item analyses indicated irregularities in the items them- 
selves for several of the domain referenced subtests, especially at 
grade 5 (see Nerenz, 1979e, 1979f , 1979g) , results are reported for 
all three subtests and administrations at each grade level. Unlike 
analyses which provide a simple estimation of the percentage correct, 
the domain referenced analysis yields two estimates — one for the item 
k(l-x ) and one for the entire domain k — and thus reflects the amount 
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difff^rently at the two schools and that different amounts of instruction 
were observed. 

Time Profiles by General Objective 

In that data were obtained on over 100 separate objectives at 
grade 5, individual reading skills were aggregated into 12 general 
objectives as outlined in Figures 5 to 7 . 

School 452 . At school 452 (Table 21) , teachers allocated time to 
seven general objectives during period A and six in period B, three 
of which had considerable time logged during each period: 06, Par,sage 
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The engaged percent of observed available time and the estimated 
engac od p3r,;ent of observed allocated time show the amount of engaged 
time for each general objective. With the exception of data for Sentence 
Meaning skills (07) during period B, these do not differ considerably 
from the overall engagement rates regardless of content reported in 
Table 19. These figures serve to further emphasize the discrepancy 
between allocated time and productive, or engaged, time which has been 
highliqated throughout the time profiles. For example, although teachers 
allocated the equivalent of 10 35-minute sessions to Passage Meaning 




10 of the 12 content areai (Tabl-- 21), although, as at school 452, very 
little time was allocated to Word Attack skills (01-05). In addition, 
since data were obtained for the entire reading period, it is understandable 
that the General Reading rategory should have the largest amor.nt 
time. With the exception of this category. Comprehension (06-08) and 
Study Skills (10-12) were allocated exactly the same number of minutes 
(530) during period A, while teachers logged almost twice as \x^Ach 
Comprehension instruction as Study Skills instruction during period B. 
In addition, emphasis was p?aced on the same skills within each element 
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for whom log allocated time was recorded are also included so that 
the representativeness of that sampled group might be considered. 

Grade 2 

Across the four test forms, 80 items were used to test 10 of the 
12 general objectives: 5 Word Attack (01-05) , 2 Comprehension (06, 
07) , and 3 Study Skills (10-12) . These items were not evenly dis- 
tributed across elements or across general objectives within each 
element but rather were designed to reflect the content that teachers 
had anticipated teaching (see Dunham, Nerenz, & Webb, 1979). 

Achievement Monitoring Scores 

At test time 1 for school 452 (Table 23) , students achieved more 
than 80% correct on two general objectives (01 — Phonic Analysis-Consonants 
and 07 — Sentence Meaning Skills) and appear to have already mastered 
the material. Over the investigation period, they generally maintained 
this level of performance for one skill (07) and continued to improve 
on the other. Scores ranged from 41% to 71% correct on the eight other 
skills. Large gains from test time 1 to test time 3 were evidenced 
for two objectives. Phonic Analysis-Silent Letters (03) and Reference 
Skills (12) , and mastery was achieved on the latter by test time 3. 
It is also interesting that students improved greatly on Skill 05 — 
Passage Meaning from test time 1 (63%) to test time 2 (86%) , but that 
from test time 2 to test time 3 their mastery declined, resulting in 
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Table 23 

Percent Correct for Three Administrations of the Achievement 
Monitoring Tests and Gain Score For General Objectives 
(School 452, Grade 2) 



Percent correct 
Number of 



General items in Test time 1 Test time 2 Test time 3 Gain 

objectives aggregate (n=45) (n=46) (n=47) (TT3-TT1) 

01 17^ 89 91 94 5 

02 14 58 63 63 5 

03 3 53 64 68 15 

04 10 58 58 63 5 

05 8 58 68 66 8 

06 7 63 86 73 10 

07 5 83 80 81 -2 

08 0 - - - " 

09 0 - - - - 

10 8 71 66 76 5 

11 5 41 49 49 8 

12 3 63 63 81 18 



Only 16 items were included at test time 3, 



^8 



•/'J 



an overall gain of only 10%. Gains in achievement for the five remain- 
ing content areas were positive but ranged from only 5 to 8'i . 

At school 504 (Table 24) , students had already mastered Word 
Attack Phonic Analysis-Consonants (01) at test time 1 and maintained 
that mastery throughout the observation period. Scores ranged from 
29% correct on Graphs and Tables (11) to 73% correct on Sentence Meaning 
(07) for the nine remaining skills, with the Word Attack skills (02-05) 
ranging from 42 to 54% and the Comprehension and Study skills (06, 07, 
10-12) averaging somewhat higher, about 63% correct. 

Students achieved mastery on one skill (07~Sentence Meaning) by 
test time 3 and made steady progress with an improvement of at least 
10% on another three objectives (04, 05, 06), although they still did 
not achieve mastery levels. Little or no overall gain was evidenced 
for skills 02 and 03 (Phonic Analysis-Vowels and Silent Letters) . 
There is also a decline in performance from test time 1 to test time 2 
for Objective 10 — Map skills. 

C)omain Referenced Score s 

The first of the three domain referenced subtests (Table 25) con- 
tained nine items from Word Attack skill? B5, C3, and D2 and tested two- 
and three-letter consorjant blends. At both schools, it is clear from 
the large k that the domain as a whole was very easy for the students 
at all three administrations, although it was slightly less easy at 
school 504 at test time 1 and these students showed more overall gain. 
Examination of the test items shows one two-letter blend item at each 
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Table 24 

Ob jective Easinu.su for Three Adminin Ural i on: ; of tho Achievement: 
Monitoring Tests and Gain Score t'ur (^jaerai Objectiveii 
(School 504, Grade 2) 



Objective easiness 



Number of 



General items in Test time 1 Test time 2 Test time 3 Gain 



objectives aggregate 



03 3 

04 10 

05 8 

06 7 

07 5 

08 0 

09 0 

10 8 

11 5 

12 3 



(n=61) (n=64) (n=62) (TT3-TT1) 



01 17^ 83 84 82 -1 

02 14 



54 62 54 0 

42 56 46 4 

42 52 55 13 

52 59 65 13 

60 65 76 16 

73 80 86 13 



63 53 54 -9 

29 29 38 9 

67 69 71 4 



^Only 16 items were included at test time 3, 
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(Li rr i .s-r'(.)tirl man Ttoin ar\cl I)c)mc»in nirfioully fiu 
;:iubtuiit 1: ConMoiuinl: IUuikIm 
(Sc:lioo.la 4[i2 and 5(M, (Iraclo 2) 



School 452 School 504 
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Item k(l-x^) k k(l-x^) k 

Test time 1 



1 


.94 


.88 


2 


.86 


.73 


3 


.83 


.82 


5 


. 74 


.69 


6 


.92 


.79 


7 


.84 


.76 


9 


.84 


. 61 


10 


.76 


.49 


11 


.74 


.59 




.96 






Test time 2 




1 


1.00 


.89 


2 


1.00 


.88 


3 


.70 


.34 


4 


1.00 


.86 


5 


1.00 


.81 


6 


1.00 


.84 


7 


.81 


.58 


8 


.87 


.69 


9 


.72 


.39 




1-00 






Test time 3 




1 


.92 


.96 


2 


1.00 


.94 


3 


.99 


.93 


4 


.62 


.74 


5 


.98 


.88 


6 


. 83 


.74 


7 


.71 


.66 


8 


.29 


.25 


9 


. 81 


.75 



.89 



.98 



1.00 .98 



t imofj 1 i\\n\ \, i tMiUM ') Mhil -l i hm) mm 't. i vtM y ImmImiI llif hlninl jA' lu 
t li<» lUMUUMUin w<.)r(lsi jfA'i 'i/ diicl jr/vi?i Wx' A ' . I t.nu\ 1 at '..(wM. t.inu? .! ujumI (.hi! 

Ml iuuiluii Wl)l'<l iN*i/.////i-7/ 'iMu^iUt two |)|nU<lfi il.iVt* ImmMI IUu|«' (iitl|('\l)l 

or rlitj Ml uiUnU:'* may havt^ bt.uin luluUul by \.\h\ nuuMnnjU' woi ils I ImmiumiM vi^m . 
I'n adil i t: ion , Uho laMt: throe i.l.^'iUM in (Mt^'l) ailin i n i Ml.r.it i on t.Ur«M"- 
l(jt:t:.(»r blonclw anci wuru also qiineriill y ir.ort* tl i f T i cm 1. 1., uMiuMjia lly al: 
achool [504. 

A.^ was the case t>n BubtosL 1, .MubLoMt l^-"-ConLral U'houcfhL: M'opif 
of a Passage without Organizer (CC C3) was relatively easy at ail throe 
test administrations, with students scoring almost identically across 
the two schools (Table 26) . Although the tost was developed to measure 
the skill in four independent and four dependent passages, at least 
two of the independent paragraphs at test time 1 (items 16, 17) and 2 
(items 10, 13) are structurally more like dependent passages and, at 
eill three test times, items having more features of independent passages 
appear to be somewhat easier. 

Two aspects of the Alphabetizing skill (SS C?,l) were tested on 
subtest 3 — Alphabetizing by the first letter or by the first and 
second letters (Table 27), At both schools, it appears that alphabetiz- 
ing by the first and second letters was generally easier, especially at 
test times 1 and 3, perhaps because the second letter was often a vowel 
and thus the ordering process was considerably simplified. Unlike sub- 
tests 1 and 2, for subtest 3 the domain difficulty (k) is quite different 
across schools: Students at school 452 started lower and gained 13% to 
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llairiM I'uai hium I (urn aiul i)*>main nil tiituh y u»t 

a PaiiJiaiK^ wil-html. au i)n|auliun 



IUjUod I. '1').! jUihou I 'iO'l 

It AMU k(.l,-K^) k k(l.--x^) k 

TuiiU LiiiKi 1. 

13 .1.0 .03 

14 .77 .75 
ib .65 . 35 
17 .30 .12 
IB .57 .60 

19 .35 .28 

20 .39 .32 
22 .56 .39 

.88 .09 

Test time 2 

10 .15 .09 

11 .58 .47 

12 .HJ .79 

13 .45 .29 

14 .64 .^2 

15 .42 .41 

16 .72 .62 

17 .57 .32 

.85 .86 

Test time 3 

10 .95 .94 

11 ."'4 .73 

12 .86 .89 

13 .76 .81 

14 .59 .47 

15 .70 .79 

16 .49 .50 

17 .46 .43 

.95 .95 
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ll.iM I M -Pt^t r 1 itiau t (tun .tiul Dixtviiu I) i r 1 i i iii i I y 
Sulil.tiM I. ] : A1.i>1mIki(> U'» lut( 
(Jailinul.n -ISJ and *U)4 , (Iradt^ 10 



I-t.iun k(l.-x^) k k(l.-K^.) k 

Ttjst Li mo 1 

2 3'^ .61 .70 

213 . .56 .67 

26'^ .62 .68 

27 .55 .58 

28'^ .62 .69 

29 .43 .51 

32 .49 .57 

.72 .77 

Test time 2 

18 .68 .64 

19^ .64 .60 

20 .62 .55 
21^ .60 .66 
22^ .69 .64 

23 .56 .48 

24 .64 .51 
25^ .56 .40 

.84 .71 

Test time 3 

18^ .76 .59 

19^ .74 .61 

20^ .65 .58 

21 .70 .53 

22 .51 .53 

23 .64 .60 

24 .48 .44 
25^ .68 .62 

.85 .72 



a 

These items test alphabetizing by the first and second letters. 
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Comparison of Targ et Student s t o Total Group 

Comparison of achievement scores provides an estimate of the repre- 
sontditiveness of the children for whom logs were maintained by comparlrn) 
their percentage correct on the domain referenced tests with those of 
the total group. At school 452 (Table 28) , average scores for the 
total group and the six-student subgroup differed by less than 1 point. 
At school 504 (Table 29) , average scores of the two groups differed 
from .6 to 2.5 points with only four of the nine differences less than 
1 point. Thus, the students for whom logs were maintained at school 504 
are somewhat more proficient than the total group with regard to the 
Comprehension and Study Skills objectives which were tested and the 
logs may reflect a profile of instructional time for more advanced 
students rather than for the average grade 2 child. 

Contrast Between Schools on Achievemen t 

Students at schools 452 and 504 had mastered skill 01 — Phonic 
Analysis-Consonants at test time 1. At school 452, initial achievement 
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Table 29 



Achievement Scores for Three WDRSD Reading Skills: Achievement Monitoring Percentage Correct for the 
Total Group and Domain Referenced Percentage Correct, Mean, and Standard Deviation 
for the Total Group and for Six Target Students 
(School 504, Grade 2) 









Teat tifne i 
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1 1 mo 2 






Tf^st tim,; 3 










Esti- 


Domain 


Do ma III 




Doinain 


DoiTiciin 




[■;sti- 


Domain 


Domain 
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refer- 
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ment domaiii 
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doiHcUIl 


iiiced 


enced 
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total 


target 


moiutor- dif fi- 


total 
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nioiii tor- 


diffi- 


total 
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.a 
Objectives 
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culty 




students 


u\i] cuity 


qroup 


btudiMits 


inq 


culty 




st'jdentb 


Consonant blends 




.7') 


.B9 


.70 


.78 




.70 


.m 


.94 


M 


.71) 




(WA B5, C3, D2) 




























Mean 








7.0U 




6.3 


1.2 






G.B 






sp 












2.2 








i/) 




Ctnti'di thought: 












.60 .86 


.44 




.91 


.95 


.7(j 




Passage without 


























organizer 


Mean 








4.O0 




3.6 








i).0 


6.B 


(CC C3) 








1.5 






1.8 








1.7 




Aiphabetiziag 






. 77 


M 


.79 


.69 .71 




.BI 


.71 


.72 


.% 


.HH 


(SS Cll} 


































5,0 








f).S 






4.S 






sn 






2. 'J 






3.0 








3.0 





Consonant blends were tested using eight itums on the Achievement Monitorirui Tests and nine items on the Domain Referenced Tests; two and eiqht 
items were included for the central thought objective, and three and eiqht items were used to test Alphabetizinq on the two types of tests. 
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in skill 07 — Passage Meaning was also high and by test time 3, students 
had mastered one additional skill, although this differed by school. 
At neither school, then, was a mastery level of 80% or more correct 
achieved for a majority of the general objectives for which data were 
obtained. 

Variations in initial achievement and type of progress were also 
clear. At school 452, there was very little difference in initial 
achievement for many of the skills, and substantial gains were made 
for only two objectives (03, 12) with the percent correct for one ob- 
jective (05) declining by test time 3. At school 504 there was con- 
siderable difference in initial scores such that a Word Attack skills 
group and a Comprehension and Study Skills group might be considered. 
Steady gains across test times were evidenced for four objectives (04, 
05, 06, 07), with gains in two areas (02, 03) and achievement in one 
area (10) declining over time. 

The attainment of a mastery level on the skills tested using both 
procedures seems to vary depending on the measure considered, with 
students at both schools making gains on Consonant Blends and Central 
Thought, while in Alphabetizing, scores at school 452 improved and at 
school 504, declined. The representativeness of the random sample of 
students for whom logs were maintained might also be carefully considered 
in that their scores on the domain referenced tests at school 504 were 
consistently higher than those of the total group. 
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Grade 5 



At grade 5, the 80 test items on the four test forms were divided 
such that 8 items tested three of the five Word Attack general ob- 
jectives, 20 items tested three of the four Comprehension objectives, 
and 52 items were partitioned among the three Study Skills areas. As 
at grade 2, this allocation of test items was based on teachers' per- 
ceptions of the content to be covered as well as suggestions made by 
the developers of the WDRSD program. 

Achievement Monitoring Scores 

At school 452 (Table 30) , students had mastered only one active 
(07 — Sentence Meaning) at test time 1 and this was the only skill for 
which achievement reached 80% at the final testing. Students made sub- 
stantial gains in two additional areas from test time 1 to test time 2 
(01 — Phonic Analysis-Consonant Blends and 08 — Word Meaning) but achieve- 
ment declined by test time 3. For the remaining skills, students evi- 
denced either small gains or slight decline- A pattern of steady 
growth across test administrations is not reflected in these scores. 

At school 504 (Table 31) , students had not mastered any of the 
skills at test time 1. They mastered one (01 — Phonic Analysis-Conrionants) 
by test time 3 and had substantial gains on three others: 03 — Phonic 
Analysis-Silent Letters, 06--Passage Meaning, and 08 — Word Me^aning. 
For two of the skills (10, 12) there is almost no change in achievement, 
but for one other (11) the gain is more steady, with two others (04, 07) 
showing gain from test time 1 to test time 2 and loss from test time 2 
to test time 3. 
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Table 30 

Objective Easiness for Three Administrations of the Achievement 
Monitoring Tests and Gain Score for General Objectives 
(School 452, Grade 5) 



Objective easiness 
Number of ■ ^ 



General items in Test time 1 Test time 2 Test time 3 Gain 

objectives aggregate (n=39) (n=40) (n=40) (TT3-TT1) 

01 3 66 97 74 8 

02 0 - - - - 

03 3 55 63 50 -5 

04 2 70 75 74 4 

05 0 - - - - 

06 10 71 71 62 -9 

07 4 80 88 80 0 

08 6 60 80 74 14 

09 0 - - - 

10 16 58 63 64 6 

11 12 67 73 76 9 

12 24 51 53 48 -3 
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Table 31 

Objective Easiness for Three Administrations of the Achievement 
Monitoring Tests and Gain Score for General Objectives 
(School 504, Grade 5) 



Objective easiness 
Number of 



General items in Test time 1 Test time 2 Test time 3 Gain 

objectives aggregate (n=62) (n=60) (n=60) (TT3-TT1) 

01 3 79 69 84 5 

02 0 - - - - 

03 3 29 46 47 18 

04 2 68 77 74 6 

05 0 - - - - ' 

06 10 58 62 74 16 

07 4 64 78 73 9 

08 6 49 68 70 21 

09 0 - - - - 

10 16 54 51 53 -1 

11 12 59 61 68 9 

12 24 44 43 45 -1 
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Overall , it is clear that students did not reach a mastery level 
of 80% correct for a large number of the skills although they did score 
better than 70% correct on five of the nine areas tested. Substantial 
gains are more evident at school 504 than school 452, although at 
neither school does there appear to be con&i:^tency on many objectives 
over time. 

Domain Referenced Scores 

On the first subtest, Outlining (SS F 11) , students scored over 
80% correct at all three test times with a gain of 8% at school 452, 
and over 80% correct at test times 1 and 3 at school 504 with a loss 
of 5% (Vable 32) . In that three items were developed for each of 
three test passages on each form, it appears, especially at test time 1, 
that the passages themselves were harder or easier to outline. Over 
the three test times, items which were more difficult often seemed 
to have too many or too few major points or had qualifying phrases 
such that the major points were not easily identified simply by the 
layout of the text. 

On the second subtest. Indirect Clue-Application, students 
were to complete a sentence containing a nonsense word and then to 
define the nonsense word on the basis of context clues provided in 
the text (Table 33) . Students at school 4S2 improved over the testing 
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Table 32 

Harris-Pearlman Item and Domain Difficulty for 
Subtest 1: Outlining 
(Schools 452 and 504, Grade 5) 





School 452 




School 


504 


Item 


k(l-x^) k 




k(l-x^) 


k 




Test time 


1 






J. 


1 A 




. 38 






• oU 




. 59 




J 


"a n 




. 33 




A 
H 


"7 Q 

• /y 




. 86 




•J 


"7 c: 
• /D 




.83 




Ci 
\J 


. / / 




. 80 




7 


C A 




. 79 




Q 
O 






. 64 




9 


.67 

.86 
Test time 


2 


.76 


.88 


1 
J. 






. 38 






A C\ 




. 46 




■a 


. DO 




. /I 




*» 






A A 

. 44 




•J 


. / ^ 




. 57 




Ci 

\j 


/I O 




. 39 




7 


.30 




. 58 




Q 
O 


/l C\ 
. fiU 




. 39 




9 


.25 

.85 

Test time 


3 


.14 


.75 


1 


.70 




.48 




2 


.18 




.21 




3 


.57 




.68 




4 


.75 




.75 




5 


.87. 




.81 




6 


.71 




.68 




7 


.82 




.78 




8 


.94 




.71 




9 


.85 

.94 




.70 


.83 
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Table 33 

Harris-Pearlman Item and Domain Difficulty for 
Subtest 2: Indirect Clues — Application 
(Schools 452 and 504, Grade 5) 



School 452 School 504 



Item k k k (1-x^) k 



Test time 1 

13 .44 .45 

15 .31 .34 

16 .68 .69 

18 .52 .53 

19 .02 .02 

20 .18 .10 

21 .58 .70 

22 .36 .36 

.73 .77 

Test time 2 

10 .50 .56 

11 .28 .23 

12 .56 .58 

13 .44 .45 

14 .24 .11 

15 .50 .53 

16 .43 .48 

17 .36 .40 

.74 .72 

Test time 3 

10 .66 .66 

11 .57 .30 

12 .44 .27 

13 .18 .19 

14 .49 .43 

15 .21 .37 

16 .64 .64 

17 .26 .08 

.84 .76 
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period, with the domain difficulty estimated at .84 at test time 3. 
At school 504, scores declined at test time 2 and returned to their 
original level at test time 3. The low scores for items 19 and 20 at 
test time 1 and item 11 at test time 2 are due to the fact that the 
nonsense terms might logically be replaced by a variety of English 
words, only one of which was considered correct. Other low scores 
appear to be due to the difficulty of the English word (estimate, 
frontier/wilderness, lingered, disturbance) . There was no evidence 
that either the particular type of clues (contrast, modifying phrase, 
example, cause and effect) or the part of speech replaced (noun, 
verb, adjective, adverb) had an effect on the difficulty of the item. 

On subtest 3 (Table 34) , students were to read a paragraph and 
determine whether the conclusion which was provided was correct, jus- 
tifying their assessment using two facts from the passage. This sub- 
test was very difficult for students at both schools at test time 1 
(k = .51, .58) although the domain difficulty rose to .86 and .83 by 
test time 2 and steadied at .79 by test time 3. There are very few 
items for which the low scores may be explained by the item construc- 
tion itself. Students tended to score higher on items for which an 
incorrect rather than a correct conclusion was provided; it is possibly 
easier to find facts denying an inconsistent conclusion than to verify 
a correct one. 

Comparison of Target Students to Total Group 

An estimate of the representativeness of the children for whom 
logs were maintained is provided by comparison of their average scores 

it? 

o 
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Table 34 

Harris-Pearlman Item and Domain Difficulty for 
Subtest 3: Conclusions — Indirect Relationships 
(Schools 452 and 504, Grade 5) 



Item 


School 452 




School 


504 


k(l-x^) k 


k(l-x^) 


/N 

k 




Test time 


1 
















24 






so 




25^ 






■ ^ ^ 




26 










27 










28^ 


- 36 




44 




29 


-21 




-27 




30^ 


-23 




- 31 






.51 






-58 




Test time 


2 






18^ 


, 70 




.68 




19 


- 74 




- 66 




20 


- 59 




52 




21 


- 3 3 




1 7 




22 


- 63 








2 3^ 


- 52 




m -J -J 




24^ 


-55 




-57 




25^ 


-62 




-58 






- 86 






.83 




Test time 


3 






18 


-76 




-53 




19^ 


-75 




-43 




20^ 


-89 




-65 




21 


-70 




.33 




22^ 


-77 




-60 




23 


-47 




-35 




24^ 


-47 




.45 




25 


-63 




.49 






.79 






.79 



For these items, incorrect conclusions were provided- 
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with those of the total group. At school 452 (Table 35) , the sampled 
six-student subgroup scored higher in seven of the nine instances. At 
school 504 (Table 36), scores for the two groups differed from .7 
to 2.2 points with the subgroup for which logs were maintained having 
higher scores in each of the nine comparisons. As at grade 2 at school 
504, the logs may present a profile of time allocations which are not 
reflective of the typical pattern of grade 5 reading skills instruc- 
tion. 

Contrast Between Schools on Achievement 

Students evidenced only small changes in achievement for all but 
a small number of the 12 general objectives at each school, with 
larger gains for more objectives at school 504 (Objectives 03, 06, 
08) than at school 452. It is interesting, however, that the niomber 
of skills for which students reached a mastery level of 80% on the 
achievement monitoring tests was not significantly larger at test 
time 3 than at test time 1 at either school, although this apparent 
lack of growth may be inaccurate in describing school 452 where students 
mastered three skills at test time 2 and showed declines in achievement 
by test time 3. A pattern of steady achievement across test administra- 
tions was not characteristic at either school, being evidenced for only 
two skills (10, 11) at school 452 and two skills (06, 11) at school 504. 
In addition, in none of these four instances did students reach a level 
of 80% correct and in three of the cases the overall gains were not 
large. 



Table 35 



ID 

00 



Achievement Scores for Three WDRSD Reading Skills: Achievement Monitoring Percentage Correct for the 
Total Group and Domain Referenced Percentage Correct, Mean, and Standard Deviation 
for the Total Group and for Six Target Students 
(School 452, Grade 5) 



Test time 1 Test tinit 2 Test time 3 
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Indirect clues: 
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.74 
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Application 




























(CC F2) 


Mean 






3,2 
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3,3 
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SD 






2.1 








2,3 








1,9 




Conclusions; 
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.35 
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,60 
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Outlining was tested using three items on the achievement monitoring tests and nine on the domain referenced tests . Indirect Clues was tested usintj 
and eight items, respectively, and.three and eight items were used to test Conclusions: Indirect Relationships on the two types of tests* 
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Table 36 



Achievement Scores for Three WDRSD Reading Skills: Achievement Monitoring Percentage Correct for the 
Total Group and Domain Referenced Percentage Correct, Mean, and Standard Deviation 
for the Total Group and for Six Target Students 
(School 504, Grade 5) 
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Conclusions: 
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Outlining was tested using three items on the achievement monitoring tests and nine on the domain referenced tests. Indirect Cloi-s was tested using 
three and eight items, respectively, and three and eight items were us^-d to test Conclusions: Indirect Relationships on the two types of tests. 
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Finally, the achievement data suggest that the representativeness 
of the random sample of students for whom logs were maintained might 
be reconsidered at school 504, in that scores for the subgroup were 
considerably higl.c r than those of the total group for all subtests at 
all administrations • 
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VII 



INTERRELATIONSHIPS BETWEEN THE TIME AND ACHIEVEMENT VARIABLES 

As outlined in Chapter I, the primary purpose of the WDRSD Des- 
criptive Study was to describe the way in which the curriculum program 
was implemented and to relate the time variables to achievement on 
specific reading skills. Background information about the schools 
themselves as well as basic data concerning means of instruction, time, 
and achievement were reported in Chapters III through VI, and this 
chapter concerns the interrelationships among the variables in order 
to examine the effects cf teachers' and students' use of time on actual 
performance. 

The most direct type of relationship between instructional time 
and achievement is a linear one in which gain in achievement is thought 
of as directly related to the amount of time spent on specific aspects 
of the siabject matter. While such a model only approximates the 
actual relationship and does not consider additional factors such as 
skill difficulty, prior achievement, and means of instruction, a simple 
linear model provides a point of departure for discussing the relation- 
ship between instructional time and achievement. We will consider this 
model of direct relationships first. Following this discussion, a more 
detailed analysis of the relationship as it is illustrated by specific 
Word Attack, Study Skills, and Comprehension objectives will be pro- 
vided. 
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At each grade, nine of the 12 general objectives had time allocated 
on teacher logs and were represented on the achievement monitoring 
tests. At grade 2, objectives 8 and 9 were not included in the achieve- 
ment monitoring tests, while for objective 12 no time was allocated. 
At grade 5, objectives 2, 5, and 12 were not included in the achieve- 
ment monitoring tests. Pearson product-moment correlations were cal- 
culated between average gain on the achievement monitoring tests and 
number of minutes of allocated time for these nine objectives separately 
for periods A and B, a total of 18 cases at each school and grade level. 
Results are provided in Table 37 and plotted in Figure 8. 

As indicated by these correlations, there does not appear to be 
a significant linear relationship between allocated time and achieve- 
ment variables. Since complete data were not obtained for all cases 
on observed available, engaged, or estimated engaged time, no further 
correlations were calculated. 

Several aspects of the data analysis should be considered in in- 
terpreting these correlations. First, to this point in the report 
and more generally in the analysis of the descriptive studies as a 
whole, data about instructional time have been presented in terms of 
12 aggregates of skills, or general objectives. As explained in 
Chapter II, aggregations to these general objectives were made on the 
premise the instruction on a single skill might affect performance on 
related skills and that because of the transfer effect differences 
among skills within a general objective would not be sufficiently 



Table 37 

Correlation between Average Amount of 
Allocated Time Per Child and 
Achievement Gains for General Objectives 



School Grade 

452 2 .13 

504 2 ".002 

452 5 -.03 

504 5 .02 




Horizontal axifi: allocated time in minutes 
Vertical axis: achievement gain or Iohs 
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larcje to have an impact on the relatioushii^M between time and achiove- 
ment under consideration. 

For the most part, this assumption does not appear to reflect the 
intentions of the curriculum developers. The writers of the WDRSD recog- 
nized the interrelationships between certain skills and considered that 
instruction in some skills may, for some students, affect performance 
on other related skills. Realistically, however, the developers warned 
against assuming mastery for a skill based on a student's performance 
on a closely related skill. For example, teachers were cautioned 
against assuming that if a student showed mastery for Word Attack B3 — 
Beginning Consonant Sounds, he or she would also demonstrate mastery 
for Word Attack B4 — Ending Consonant Sounds, In other words, some 
students, as a result of working with one skill, may develop the ability 
to use a closely related skill (e.g., a stucient who has been given in- 
struction in beginning consonant sounds may recognize and identify 
ending consonant sounds without focused skill group instruction) . 
The assumption cannot be made, however, that this would be true for 
all students. Separate skills were identified to ensure that teachers 
would provide instructional time for each skill which students had not 
mastered. 

The implications of this position for the type of data aggrega- 
tion used in this study are clear: Unless teachers allocated time to 
each skill within a general objective, there is no reason to expect 
a strong relationship between allocated time and achievement gains 
over the three test administrations. While it is still conceivable 
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that a transfer effect may be useful in dealing with certain of the 
yoneral objectives, t-.}\e problem created by aggrecjation is very clear 
for at least two general objectives at grade 2 (04 — Structural Analy- 
sis and 06 — Passage Meaning skills) and three general objectives at 
grade 5 (06 — Passage Meaning skills, 10 — Map skills, and 12 — Reference 
skills) . In these five instances, from three to six strands containing 
between 10 and 23 individual skills were each aggregated under single 
general objectives. 

One jpossible explanation for the apparent lack of relationships 
betv/een instructional time and achievement focuses on the research 
methodology customarily used to aggregate data across a content area. 
This explanation suggests that when detailed skills among which there 
ere fow established links or points of transfer are under considera- 
tion, traditional forms of aggregation constitute a less effective 
basis for analysis. 

A second aspect of the data analysis which might be considered 
in explaining the nonsignificant correlations between time and achieve- 
ment variables deals with the manner in which children were grouped. 
Up to this point in the report, data have most frequently been pre- 
sented for the entire group of students rather than for individual 
children. However, because research sites were selected on the basis 
of their characterization as IGE schools, it may be assumed that at 
least some emphasis was placed on instructional programming for the 
individual student. 
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Looking at Tablo 38, where an example of log allocated time for 
six randomly seimpiecl target students is presented, it is evident that 
all students did not receive the same amount or type of instruction 
(for data for other grades and schools, see Nerenz, 1969a), In fact, 
about one-half of the students received instruction on specific Word 
Attack skills and one-third received instruction on Study skills or 
Comprehension objectives. In addition, the same amount of time on a 
particular skill was allocated to two students in only a small number 
of cases. Apparently instructional time was allocated to different 
children in different ways. 

However, the figure used in calculating the relationship between 
instructional time and achievement represented the average number of 
minutes per child: That is, the total amount of allocated time per 
skill area was averaged using the niimber of children for whom logs 
were maintained rather than for the niimber of children who received 
instruction (one-half to one-third of the total number of children) or 
simply for the individual child under consideration. While such 
analysis representing the entire group may be effective when large 
group instruction is provided such that the instructional program varies 
only slightly for individuals within the group (see the DMP Descriptive 
Study Final Report, Webb, in press) , this type of analysis is clearly 
less effective in describing instructional time in a more individual- 
ized program like the one described above. Thus, a second possible 
explanation for the nonsignificant relationships between the time and 
achievement variables focuses on the appropriateness of using traditional 
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Tabio M\ 

Allocated Time from Teacher Locjs 
By Topic and Objective for WDRSD 
(School 452 r Grade 2) 



Percent of Time in minutes for each student 

allocated Total — — — - — ■ — — 

Activity time time 13 15 16 18 23 38 
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.LH beincj considered r timo data wore ticaled and then correiatod with 
achievomont as outlined below. 

First, the time allocations wore adjusted to reflect the averacjo 
number of minutes allocated to the children who received instruction 
rather than the average number of minutes per child: The number of 
logged minutes was multiplied by the proportion of children receiving 
time (1 of 6 = .17, 2 of 6 = .33, 3 of 6 = .50, and so forth) and this 
product was then multiplied by the number of children in the class or 
unit. For example, if 200 minutes were logged on Word Attack B3 for 
three of the six children for whom logs were maintained and there were 
30 children in the class, then the following calculation was used: 
200 minutes x 3/6 x 30 = 3,000 minutes. Thus, the adjusted time allo- 
cation was made to reflect not only the absolute niimber of minutes 
but also the percentage of the unit to which those minutes were allocated. 

These adjusted time allocations were then correlated with gain 
scores for the individual reading skills which were tested rather than 
with aggx'egated groups of skills. Because time was not logged to every 
skill at every school, the number of cases entering into the calcula- 
tion differs by grade and by school. The number of cases used in each 
correlation, a correlation using periods A and B as separate cases, 
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While this may be due to the quality of the relationship bctwoon 
the variables or to the procedures used during data collection and 
analysis, at least one aspect of the data should be considered in in- 
terpreting the nonsignificant findings. 

As noted in the Teacher's Planning Guide: Word Attack for word 

attack skill instruction (Otto & Askov, 1972) : 

To implement the Word Attack element effectively, at least 
two hours per week should be allotted to skill group in- 
struction .... Since . . . most skills require approxi- 
mately three to ten hours of instruction, skill groups may 
have to extend beyond two to three weeks if children are 
simultaneously given instruction in several skills (p. 15) . 

Thus, for Word Attack in the primary grades, at least 240 to 360 minutes 
should be scheduled per child/per skill. Similar statements were made 
regarding the amount of time which the developers suggest be devoted 
to instruction in the Study Skills and Comprehension elements (Chester, 
Askov, & Otto, 1973; Otto & Kamm, 1977) : To provide a minimum of 
comprehension and study skills instruction, it is recommended that at 
least 40 minutes per week totaling 120 minutes per skill be allocated 
to each of the two elements at the primary level and at least 150 to 
180 minutes per week be allocated to each element at the upper elemen- 
tary level . 
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Table 39 

Correlation between Average Amount of Allocated Time Per 
Child and Achievement Gains for Individual Reading Skills 



Periods A and B Total period 



School Grade Number of cases r^ Number of cases r 

452 2 42 ,16 21 ,24 

504 2 38 ,24 19 .21 

452 5 22 -.20 11 -.24 

504 5 32 ,02 16 .13 



136 



Horizontal axle: allocated time In thousands of minutes 
Vertical axis: achievement gain or loss 
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Figure 9- Scatterplots of average amount of allocated time per 

child and achievement gains for individual reading skills. 
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Figure 9 (continued) 
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By summing the total number of minutes allocated to each of the 
three WDRSD elements (Word Attack, Study Skills, Comprehension) using 
data in Tables 16, 11, 21, and 22, an estimate of the average number 
of minutes allocated to each element per week was obtained. This 
figure is compared in Table 40 with the developers' recommended time 
allocations discussed above. 

Table 40 shows that the minimum number of minutes which the WDRSD 
developers recommended generally exceeds the average number of minutes 
which were actually allocated at grade 2 for both schools across the 
three elements. The number of minutes allocated to instruction was 
larger than the minimum recommended time only for the Comprehension 
element at school 452. In four of the five other cases, about 60% of 
the recommended amount of time was logged as being spent in instruction, 
although the difference between recommended cuid allocated time is not 
very meaningful for Study Skills or Comprehension at school 504 since 
those elements were not implemented. 

A similar situation appears at grade 5, where the average number 
of allocated minutes exceeds the recommended level only for Comprehen- 
sion at school 504. This, however, may be due to the fact that the 
entire reading period was logged and thus a large amount of general 
reading was coded under the Comprehension element. In addition, since 
Word Attack and Study Skills were not really implemented in the upper 
elementary unit, the comparisons for school 504 are less useful. How- 
ever, at school 452 where all three elements were used, less than one- 
half of the suggested minimum time allocations for Study Skills and 
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Table 40 



H 
H 

0^ 



Number of Minutes Allocated and Recownded Per Week Per Child 
for Three WDRSD Elements by Grade for Schools 452 and 504 



School 452 School 504 School 452 School 504 

Grade 2 Grade 2 Grade 5 Grade 5 



WA SS C WA SS C WA SS C WA SS 



Total logged 1,090 340 850 1,054 62 458 60 1,000 1,010 110 770 3,570 
minutes 



Average number 78 24 61 75 4 33 4 71 72 8 55 255 
of minutes 
allocated 
per week 



Minimum 120 40 40 120 40 40 30 150 180 30 150 180 

recommended 
number of 
minutes to 
be allocated 
each week 
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Comprehension were actually logged, with the small amount of time 
allocated to Word Attack probably due to the fact that most students 
had already mastered those skills. 

Overall, then, relatively large differences exist between the 
amount of time which was allocated and the amount of time the developers 
considered necessary for continuous skill development and mastery. In 
that less than the minimum amount of time was allocated especially to 
Word Attack at grade 2 and to Study Skills and Comprehension at grade 5, 
it is not surprising that thero are very few large gains in achievement 
over the investigation period. Thus, a final explanation of the non- 
significant correlations between time and achievement suggests very 
simply that an insufficient amount of time was allocated to instruc- 
tion, resulting in small and relatively unstable changes in students' 
performance . 
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